You need both types of testing to get (some) insights.
“Both these complementary types of user research play important roles in an iterative design cycle. Qualitative research informs the design process; quantitative research provides a basis for benchmarking programs and ROI calculations.”
Raluca Budiu a.k.a. /ralucabudiu | @rbudiu ~ Nielsen Norman Group ★
Good old usability testing for brand new technologies.
“The philosophy behind usability testing for speech-enabled systems is shared with general usability practices, but many usability practitioners have little or no experience testing speech interfaces, and the specific techniques required for collecting valid and reliable data are not widely understood. Spoken language and conversation have a number of properties that should influence the methods used to test speech user interfaces.”
Susan L. Hura a.k.a. /susan-hura | @SpeechUsability ~ Journal of Usability Studies 12.4 ★
Some real research provides sound results.
“In this paper, we report on a use case study involving 70 participants. They first took part in user/laboratory tests and then were asked to evaluate their experience with the two systems (perceived UX) by filling out an AttrakDiff scale and a UX needs fulfillment questionnaire. We conducted post-test interviews to better understand participants’ experiences. We analyzed how the participants’ perceived UX depends on quantitative (e.g., task completion time, task sequence, level of familiarity with the system) and qualitative aspects (think aloud, debriefing interviews) within the laboratory context.”
Carine Lallemand a.k.a. /carinelallemand | @Carilall and Vincent Koenig a.k.a. /vincent-koenig ~ Journal of Usability Studies 12.3 ★
How team work is determined by its context.
“Sometimes people create conflicts during a project that only serve to get in the way of making meaningful things together. Or in other words, unnecessary and petty battles make work not fun and not productive. But why would people create such conflict? Perhaps a project was plagued by one, all, or some of the following factors: requirements were not collected or understood clearly, the core of the offering was not defined properly, there was too much distance between the customer and the project goals, too much money had been spent already for the project to fail, or it could be as simple as people just not knowing how to get along. All of these factors can make an environment of fear and uncertainty that prevents people from working together to create wonderful products and services. What elements of a project should we all be thinking about to help bring people together to make meaningful things together?”
Daniel Szuc and Josephine Wong ~ Journal for usability studies ★
Just lure them into new content territories.
“Users can think they see the entire web page, although additional content exists off-screen. Designers must help users discover all relevant information.”
Kim Flaherty a.k.a. /kimflahertyux ~ Nielsen Norman Group ★
Have we left N=5?
“UX researchers and other project stakeholders often fervently debate the number of participants that are necessary for usability studies. At the core of this debate is often the tension between the usability professional’s desire for the best possible study and the business team’s desire to reduce time and expense.”
Janet M. Six a.k.a. /janetmsix | @JanetMSix and Ritch Macefield a.k.a. /dr-ritch-macefield | @Ax_Stream ~ UXmatters ★
Your self image is never the same as the worlds perception of you. Even if it’s your professional image.
“This research investigates the ways usability/user experience professionals describe themselves for different audiences and across multiple digital platforms, including LinkedIn, Twitter, portfolio websites, and business websites. By analyzing the digital identities of over 40 usability/user experience professionals, this article presents quantitative and qualitative pictures of how usability and user experience is being described in digital spaces. This article highlights broad patterns and specific tactics being implemented by four types of usability/user experience professionals and gives recommendations for how these tactics can be modified and applied for other usability/user experience professionals attempting to create professional identities in digital spaces.”
(Rebecca Zantjer and Laura Gonzales ~ Journal of Usability Studies August 2015) ★
There comes a time that web design will be part of art history. As a design movement in the early 21st century.
“Many of today’s most popular design trends are influenced by minimalism. This web design movement began in the early 2000s, but borrows its philosophy from earlier movements in the fields of fine art and human–computer interaction.”
(Kate Meyer ~ Nielsen Norman Group) ★
Look-and-feel designers: “Look at how great our usability lab is. All our products and services have great usability.”
“In this editorial, I focus on the inherent conflict of interest that design agencies have when they are responsible for evaluating their own design work, what can be done to mitigate this problem, and the implications for the UX community. I define a design agency as a consulting firm that is hired to design (from a visual and interactive perspective) digital products.”
(Bill Albert ~ Journal of Usability Studies) ★
It’s still task-oriented. So, usability therefore. Quite something else than omni-channel or multi-device. Word, words, words. A rose is a rose is a rose.
“Multitasking involves being able to rapidly switch between different apps and to combine multiple sources of information. Small mobile screens limit users’ ability to see content from different apps at the same time, so current operating-system support for multitasking focuses mostly on switching between different apps. This increases users’ memory load, so mobile designers must help users compare and rapidly retrieve recent items.”
(Raluca Budiu ~ Nielsen Norman Group) ★
Is there or isn’t there such a thing as The Fold?
“What appears at the top of the page vs. what’s hidden will always influence the user experience—regardless of screen size. The average difference in how users treat info above vs. below the fold is 84%.”
(Amy Schade ~ Nielsen Norman Group) ★
Know your professional history. Moving from HCI to UX into a steep valley or ravine.
“In this editorial, I advocate a new form of interactive community publication (…) to respond to new creative emphases within human-focused interaction design practices and research. I have called this CLUF (creatively led user foci), pronounced like the Northern English word clough, meaning a steep valley or ravine. The realities of reflective creative practices are that we can always probe further and explore more as we work down through layers of design practice. CLUF would support a much needed online community of practice around systematic rigorous exploration of creative UX.”
(Gilbert Cockton ~ Journal of Usability Studies Volume 10, Issue 1, November 2014)
And there are so much more. Myths and misconceptions also apply to design, designers and De$ign.
“Usability testing has been around so long that it’s the most well-known and most frequently practiced user research method. So I find it amazing that there are still so many misconceptions about usability testing. In this column, I’ll debunk the most common myths and misconceptions that I’ve encountered over the years.”
(Jim Ross a.k.a. @anotheruxguy ~ UXmatters)
Look in the mirror, not to the other.
“Before you redesign your site, make sure that you understand the strengths and weaknesses of your current design. Garner design ideas and alternatives by studying your competitors. The focus of competitive tests is not to crown a winner, but to gain deeper insight into why design elements work or fail so we can make informed decisions moving forward.”
(Hoa Loranger ~ Nielsen Norman Group)
Usability being a characteristic of a product in use. UX being a mental state of a person with a product in and after use.
“I’m a big fan of usability testing. It’s a useful tool, and one that all UX designers should have in their toolbox. But we need to see usability testing in a broader context and consider its strengths and limitations.”
(Peter Hornsby ~ UXmatters)
The web as it was born is not a full-fledged magazine.
“Large images are visually appealing, but they can harm the overall user experience if they aren’t appropriately prioritized.”
(Kathryn Whitenton ~ Nielsen Norman Group)
De facto standards are still standards, if you like it or not.
“(…) the reality is that too often, resources are spent on making the site look great or creating an innovative widget, and usability is neglected until the very end of development (if it’s even ever looked at). Ideally, you’ll be doing testing throughout the project, be it testing your information architecture, creating and testing wireframes and paper prototypes, and conducting usability tests with real users on all the devices that you’re targeting with your design, all with enough time before the launch so that you can iterate your designs and test them again.”
(Katie Sherwin a.k.a. @kwsherwin ~ Nielsen Norman Group)
Mobile usability, the same as paper usability or usability of applications. What’s all the difference? The principles are the same, the instantiations not.
“In this interview Jakob Nielsen, explains the rules of mobile usability. He outlines how to create seamless experiences and why designers are plagued with featuritis. He then goes onto explain the reciprocity principle and the importance of user-centred design.”
(Dorm Room Tycoon)
It’s the omni-channel design again.
“Designing for all screen sizes must consider the capacity of the human–device communication channel, which depends on users’ memory, device portability, and screen size.”
(Raluca Budiu a.k.a. @rbudiu ~ Nielsen Norman Group)
Sharing as a design principle.
“Humans tend to return good deeds: use this social psychology law in user interface design to gain users’ trust and motivate engagement with your site or app.”
(Raluca Budiu ~ Nielsen Norman Group)