Getting quantitative insights into your design decisions.
“This is not the millionth article that will tell you to base your UX decisions on an obscure combination of metrics. Data-driven can be taken quite literally: using real data in the design process from start to finish. This is an overview of where we are now and what lies ahead.”
Peter Vermaercke a.k.a. /petervermaercke | @pvermaer ★
Fitting qualities into numbers is like fitting squares into circles.
“Somewhat confusingly, satisfaction scales also have a subgroup called satisfaction scales. I’ve broken this group into three further subgroups (unipolar rating scales, unipolar thermometers, and bipolar rating scales) as some research suggests that they have different reliability and discriminating characteristics. That gives us five common ways you’ll see satisfaction measured, with some notes about how particular scales have performed in published research.”
Jeff Sauro a.k.a. /jeffsauro | @MeasuringU ~ MeasuringU ★
But are you measuring what you want to measure?
“We take a comprehensive journey into the world of UX metrics, exploring both behavioural and attitudinal measurements, before highlighting our own single score program for user experience.”
Christopher Ratcliff and Kuldeep Kelkar ~ userzoom ★
Design thinking process in many variations.
“One way to frame the relationship between these two is that design properties describe the foundational structures on which design principles are hung. Or to use an analogy, properties are the basic rules of chess (how the board is set up, how the pieces move, etc.), and principles are the various strategies, play styles, and schools of thought.”
Yosef Shuman a.k.a. /yosefshuman | @aleafinwater ~ YosefsHuman.com ★ courtesy of @peterboersma
Using DataSci (quant) to get meaning out of UsrRes (qual).
“Simultaneous triangulation is an incredibly powerful tool to generate comprehensive and verified findings. If you only use one method, you could end up with blindspots. If you employ methods sequentially rather than simultaneously, you could run into unexplainable contradictions, like we did at first. The solution is simultaneous triangulation. Next time you have a complex research question, consider using the three-step process to mitigate blindspots and turn discrepancies in learning opportunities.”
Colette Kolenda and Kristie Savage ~ Spotify Design ★
Life is full of connections, to be made and to be found.
“At the Ulm School of Design (1953-1968), there was a promising approach to teaching visual as well as verbal communication. Although it took place in separate departments, this pioneering approach attempted to integrate form and content, theory and practice. From the school’s inception, the Information Department was established alongside the Departments of Visual Communication, Product Design and Building: writing was considered a discipline on a par with two- and three-dimensional design. While the Department of Visual Communication flourished, however, the Information Department languished, not least as a result of the school’s policy and staff conflicts. A closer look at the HfG’s history nevertheless reveals the Information Department’s overall importance to the school’s self-conception and attitude. Beyond its relevance for design history, this might also contribute to the discussion of a greater emphasis on verbal and writing competence in present day design education.”
David Oswald and Christiane Wachsmann ~ A/I/S/Design ★
From system design, to systematic design and systemic design.
“In this theme issue of She Ji, we present work from the Sixth Relating Systems Thinking and Design Symposium (RSD6) in Oslo. The emerging field of systemic design has expanded to engage with increasingly important societal issues ranging from housing and quality of life in cities, to foreign policy, immigration, and cultural development, as well as our environments and ecologies. (…) The guest-editors have co-edited a number of works in the past. We normally agree enough to co-create a shared vision for the overall thrust of the publication. But this time, we found ourselves in fruitful argument about the issues of interest or concern posed by nearly every article, which demonstrates the compelling discursive value of the ideas. The viewpoint articles in particular raised a number of micro-arguments between us. Our discussion follows, revealing the distinctions arising from each of these thoughtful essays.”
Birger Sevaldson and Peter Jones ~ She Ji: The Journal of Design, Economics, and Innovation Volume 5, Issue 2 ★
But what’s the speed of learning and how to speed it up?
“Over the last decade, as a rejection to a tired model of higher education, new educational programs and structures have emerged. Many of these are in the fields of design, digital product development, and programming. The new models of education take many forms. Some are short day-long or week-long workshops. Some are meetups and brownbags. Some are online, some offline, and some hybrid. What connects many of these models is their immediate vocational emphasis. The majority intend to train practitioners, not academics. The focus is on preparing people to do design and get jobs. (…) We need educational innovation, but not at the expense of quality. Students need the space to develop problem solving strategies. Speed is not in our favor here. Let’s all slow down.”
Jon Kolko a.k.a /jkolko | @jkolko ~ modernist studio ★
Like with second order cybernetics, the role of the researcher in the researched system is essential.
“We challenge the unquestioning pursuit of the appearance of objectivity and ingrained designer-user dualism in human-centred design research and propose a resurrection of introspection as a valid approach to investigating subjective experiences. Through comparing epistemic perspectives and reviewing the histories of introspection in several disciplines, we liberate the research field of experience-driven design from a long-lasting doubt about and the disguised and unsystematic use of this method. To establish a foundation for the further development of introspective methods, we focus on its most controversial type (i.e. researcher introspection) and discuss its strengths and weaknesses, preconditions of use, diverse ways to practise for different suitable experience-driven design research purposes, and useful techniques and tools.”
Haian Xue and Pieter M.A.Desmet ~ Design Studies Volume 63 ★
Fortunately, life is not as binary as you think.
“A/B testing is a powerful technique for evaluating the success of a specific design element, but it is not yet widely adopted among library user experience professionals. Many libraries cannot or choose not to do A/B testing on a live website for a variety of practical reasons. Appalachian State University Libraries recently piloted a variety of A/B testing that has the potential to address some of these shortcomings: a Qualtrics survey of tasks carried out on static prototype websites embedded into the survey as inline frames. The technique allowed us to capture qualitative data in the form of survey questions and link it to quantitative server data typical in live A/B tests. Prototype A/B testing allowed us to reap the benefits of A/B testing without needing to modify a production server environment. Based on our findings from a large sample of undergraduate and graduate students, we were able to justify a post-migration design choice.”
Scott Goldstein ~ Journal of Library User Experience 2.1 ★
Agile eats research, design and evaluation for (fast food) breakfast.
“In this paper we ask: “How might we take the ideas, the methods and the underlying philosophy behind agile software development and explore applying them in the context of doing research — even research that does not involve software development?” We look at some examples of agile research methods and think about how they might inspire the design of even better methods. We also try to address some potential criticisms of an approach that aims to minimize a need for Big Design Up Front by developing tighter iteration cycles, coupled with reflection and learning as part of a process for doing research.”
Michael Twidale and Preben Hansen ~ FirstMonday 24.1 ★
Design interventions for Earth System.
“Economics is a field under fierce contestation. In response to the intersecting challenges of the Anthropocene, scholars who take a broader and more critical view of current economic models have described the shortcomings of orthodox economic theory along with the severe consequences of its systemic discounting of the environment. Heterodox economists describe how the logic of neoclassical and neoliberal economics disregards the interests and needs of the natural world, women, workers, and other historically disadvantaged groups. Explorations of the household, the state, and the commons as alternative economies open space at the intersection of economics and design for incorporating and valuing the provisioning services provided by the ecological context and the undervalued work provided by certain groups of people. Design theorists, economists, social and cultural theorists, and anthropologists describe the relationship between value and values in ways that reveal how sustainable and socially just futures depend on the priorities (notions of value) embedded in the systems that determine what is designed. With these ideas, design can contribute to economic transitions with conceptualizing, modeling, mapping, framing, and other future making practices. Ecologically engaged, heterodox economics is a basis for societal responses to climate change on a scale that can make a difference.”
Joanna Boehnert a.k.a. /jodyboehnert | @Ecocene ~ She Ji: The Journal of Design, Economics, and Innovation 4.4 ★ courtesy of @KateRaworth
Seeing, knowning, and understanding are just part of wisdom.
“To change the mindset of your stakeholders from being naysayers to being advocates for user research, you must help them understand how research can add value to their product and that learnings from user research are an indispensable asset to a product team.”
Apurvo Ghosh a.k.a. /apurvo-ghosh-hfi-cua™ | @Apurvo_Ghosh ~ UXmatters ★
Rethinking design education for the 21st century, which is already almost two decades in the works.
“The demand for innovation in the creative economy has seen the adoption and adaptation of design thinking and design methods into domains outside design, such as business management, education, healthcare, and engineering. Design thinking and methodologies are now considered useful for identifying, framing and solving complex, often wicked social, technological, economic and public policy problems. As the practice of design undergoes change, design education is also expected to adjust to prepare future designers to have dramatically different demands made upon their general abilities and bases of knowledge than have design career paths from years past. Future designers will have to develop skills and be able to construct and utilize knowledge that allows them to make meaningful contributions to collaborative efforts involving experts from disciplines outside design. Exactly how future designers should be prepared to do this has sparked a good deal of conjecture and debate in the professional and academic design communities. This report proposes that the process of creating future scenarios that more broadly explore and expand the role, or roles, for design and designers in the world’s increasingly interwoven and interdependent societies can help uncover core needs and envision framework(s) for design education.”
Sapna Singh, Nicole Lotz and Elizabeth B.-N. Sanders ~ AIGA Dialectic ★
User research and what you see is not what you get.
“User research consists of two core activities: observing and interviewing. Since we’re most interested in people’s behavior, observing is the most important of these activities because it provides the most accurate information about people, their tasks, and their needs. While interviewing is also very important, the information people provide during interviews isn’t always accurate or reliable. Often, research participants don’t know why they do things, what they really need, what they might do in the future, or how a design could be improved. To really understand what people do, you can’t just ask them, you have to observe them.”
Jim Ross a.k.a. /anotheruxguy | @anotheruxguy ~ UXmatters ★
User research or user experience research?
“It’s hard to conduct user research if you don’t have anyone to research. Recruitment lets you find people that have the information you seek to learn. Recruitment is risky since the effort hinges on getting the right people in the room. There are a number of factors at play, and various methods a team can use to find the right kind of participants. Before worrying about the risks and before scheduling participants, you first must document whom you want to recruit.”
David Farkas and Brad Nunnally ~ O’Reilly Radar – Design ★
The job market for UX research follows the field of UX design practice.
“Our conclusion is that these seemingly opposing trends will persist for a while due to the different levels of research maturity in the market. UX teams of one, T-shaped UX, or UX unicorns are still in demand and will continue to be so. However, in our opinion, the demand for specialized UXers will keep growing. The increased understanding of UX by big companies is translated in the definition of job postings for ‘mixed’ UX researchers or specialized quantitative or qualitative researchers. It is likely to be a slow trend in the same way that UX took awhile to reach companies. However, and luckily, the future looks bright for anyone wishing to work in UX research.”
Muriel Garreta-Domingo a.k.a. @mparticulars and Alberto González Mosquera a.k.a. @Agonzalezmosq ~ UXPA Magazine ★
Design thinker provides a context of (digital) design.
“It’s no news that the world is changing and it is changing fast. And change demands what designer Kees Dorst says to be a need to step back from old values so that we can create a new order. And it’s in this process that designers have a key role to play. At our Master’s programme’s headquarters, Dorst explained his theory in design framing and new thinking to an audience of students, professionals, and lecturers. After the event, Ben Schouten, scientific director of the Master’s programme in Digital Design, sat down with Kees Dorst to hear more about his thoughts on the designer of the future.”
Master Digital Design (Amsterdam University of Applied Sciences) ★
The design discipline and the design practice, how are they in sync?
“In their previous work, the authors have demonstrated that the discipline of design has been superseded by a condition where conventionally set design disciplines have dissolved. In this age where design is typified by fluid, evolving patterns of practice that regularly traverse, transcend and transfigure historical disciplinary and conceptual boundaries, the authors have argued that globalization and the proliferation of the digital has resulted in connections that are no longer ‘amid,’ cannot be measured ‘across,’ nor encompass a ‘whole’ system. In short, this ‘disciplinary turn’ has generated an ‘other’ dimension—an alternative disciplinarity. Moreover, this reliance on the ‘exhausted’ historic disciplines has become obsolete as the boundaries of our understanding have been superseded by a boundless space/time that we call ‘alter-plinarity.’ The fragmentation of distinct disciplines has shifted creative practice from being ‘discipline-based’ to ‘issue- or project-based.’ Consequently, this paper presents a manifesto for the future design discipline that emphasizes disposing carefully of what you know, teaching what you do not know whilst always taking design seriously, protecting us from what we want, objecting to sustaining everything, designing without reproach, ensuring that objects are invisible but designed with care and within history whilst exploring design as an idea rather than an ideal.”
Paul A. Rogers and Craig Bremner ~ AIGA Dialectic ★
Pace layers in sync: research and sprints. I hope it will actually work.
“The key idea is to ensure that every action taken during the Agile process is aligned with the sprint objective and with solving a specific problem for the user. UX research is also there to continually evaluate and assess whether the outcome that the team has produced is successful. By implementing this strategy, you’ll have UX research embedded from the beginning to the end of the Agile process and empower your team to solve user problems with more alignment and feedback on their work’s impact.”
LaiYee Ho a.k.a. @laiyeelori ~ UXPA Magazine ★