Browse Content by Topic

Usability Testing (19)

Sample Size (18)

UX (12)

Usability (11)

SUS (11)

Task Time (11)

Survey (11)

Questionnaires (9)

Usability Problems (9)

Rating Scale (8)

Remote Usability Testing (7)

Net Promoter Score (7)

Statistics (7)

Problem Discovery (6)

Satisfaction (6)

Usability Metrics (6)

Task Completion (5)

Confidence Intervals (5)

Summative (3)

Loyalty (3)

Heuristic Evaluation (3)

SUPR-Q (3)

Formative Testing (3)

Regression Analysis (3)

User Research (3)

Mobile Usability Testing (2)

SEQ (2)

Keystroke Level Modeling (2)

Problem Severity (2)

Cognitive Walkthrough (2)

Margin of Error (2)

Credibility (2)

Card Sorting (2)

Qualitative (2)

Information Architecture (2)

Sampling (2)

Crowdsourcing (2)

Clicks (2)

PhD (2)

Benchmarking (2)

iPhone (1)

Analytics (1)

Lean UX (1)

Correlation (1)

Errors (1)

Reliability (1)

Think Aloud (1)

Post-Task Ratings (1)

Quality Assurance (1)

Task Times (1)

Task Failure (1)

Salaries (1)

Ordinal (1)

Completion Rate (1)

Z-score (1)

UI Disasters (1)

Interval (1)

Marketing (1)

Top Box Scoring (1)

Monte Carlo (1)

Return on Investment (1)

Ethonographic Research (1)

Geometric Mean (1)

Key Drivers (1)

Median (1)

Methods (1)

Evidence Based Design (1)

A/B Testing (1)

Usability Testing Topics

Measuring Errors in the User Experience

Jeff Sauro • May 15, 2012

Errors can be categorized as slips (like a typo) or a mistake (incorrect goal) and are common occurrences in usability tests. Errors are often caused by problems in an interface and lead to longer task times, higher task failure and lower satisfaction ratings. While errors can't be entirely eliminated, they can often be reduced substantially be reducing the opportunity for an error.[Read More]

How to Conduct a Usability test on a Mobile Device

Jeff Sauro • May 1, 2012

When it comes to testing websites there are many unmoderated and moderated solutions. But if you've ever tried to evaluate an app or website on a mobile phone or tablet there are fewer options. Here's our solution.[Read More]

20 Tips for your Next Moderated Usability Test

Jeff Sauro • April 10, 2012

Despite the rise in unmoderated usability testing, the bulk of evaluations are still done with a facilitator. Whether you are sitting next to the user in a lab or sharing screens with someone thousands of miles away, here are 20 practical tips for your next moderated usability test.[Read More]

20 Questions Answered about Unmoderated Usability Testing

Jeff Sauro • February 29, 2012

After the successful webinar on Best Practices for Remote Usability Testing, we received many questions about how I performed the analysis: sample size questions, time on task and other logistic issues are covered.[Read More]

Comparison of Usability Testing Methods

Jeff Sauro • January 17, 2012

There are advantages and disadvantages to the different usability testing methods: lab-based, remote moderated and remote unmoderated. A combination of methods provides a more comprehensive picture of the user experience but is not always possible. Consider these nine factors when deciding on a method.[Read More]

The Right Tool for the User Research Method

Jeff Sauro • November 8, 2011

There are many great methods for gathering insights from users and many more software tools. Here are the tools and services I use when conducting user research.[Read More]

10 Tips for Benchmark Usability Tests

Jeff Sauro • February 14, 2011

To know if design changes improved the usability of an application, you first need a baseline measure of usability from a benchmark test. Benchmark usability tests don't happen a lot, so to help you in your next test I've assembled a list of ten tips to help you get the most out of your effort.[Read More]

What metrics are collected in usability tests?

Jeff Sauro • November 23, 2010

Survey results show completion rates and UI problems dominate formative usability tests. Task time data is more common in summative usability tests, yet still prevalent in formative tests. At least half of respondents use some form of usability questionnaire in both types of tests.[Read More]

5 Second Usability Tests

Jeff Sauro • November 9, 2010

System Usability Scale (SUS) Scores from users who had only 5 seconds to assess the usability of a website were statistically indistinguishable from users who had no time limit. Users who had only 60 seconds on a website tend to rate websites as more usable than those who had only 5 seconds or no time limit.[Read More]

How many users do people actually test?

Jeff Sauro • November 2, 2010

The results of an email survey found 80% of Formative usability tests have less than 15 users. Summative usability test sample sizes are around 3 times larger for respondents who conducted both types of tests.[Read More]

What really happens in the usability lab?

Jeff Sauro • October 27, 2010

In a usability test we're taught to be neutral observers of user behavior. But what actually happens in practice? A review of 14 usability testing sessions from seven companies suggests that what we preach is a bit different than what we practice.[Read More]

How common are usability problems?

Jeff Sauro • September 29, 2010

Usability problem frequencies from 24 usability tests show that users are almost ten-times more likely to encounter a usability problem in a business application than a website. Users are about half as likely to encounter a problem in consumer software than a business application.[Read More]

A Brief History of the Magic Number 5 in Usability Testing

Jeff Sauro • July 21, 2010

Wondering about the origins of the sample size controversy in the usability profession? Here is an annotated timeline of the major events and papers which continue to shape this topic from 1982-2010.[Read More]

Five ways to make any usability test more credible

Jeff Sauro • June 23, 2010

Whether you're conducting an early stage test of a prototype or late validation, these five tips can make any usability test more credible. The tips both temper skepticism about small samples and help you avoid overstating your findings.[Read More]

Do you need a random sample for your usability test?

Jeff Sauro • May 12, 2010

You don't need a random sample to use statistics to make better decisions from your usability data. You do need to know if the users who aren't in your usability tests are different enough than those who are.[Read More]

Usability testing is not QA testing

Jeff Sauro • April 7, 2010

QA testers are not adequate substitutes for real users and usability tests are not adequate substitutes for good QA.[Read More]

Can you measure task time if users think aloud during a usability test?

Jeff Sauro • April 1, 2010

Retrospective probing of user actions and intentions allows you to get a reliable benchmark and identify problems with an interface.[Read More]

Can we trust data from professional usability test-takers?

Jeff Sauro • February 9, 2010

In a comparative test, satisfaction scores and completion rates from professional usability test-takers were nearly identical to lab-based users. However, time on task data differed significantly and showed much higher variability. For testing websites intended for a general audience the use of professional testers appears to provide mostly reliable data quickly and for a fraction of the price.[Read More]

Is there a difference in usability data from remote unmoderated tests and lab-based tests?

Jeff Sauro • December 8, 2009

Is it possible to get the same data from lab-based tests by having users test themselves? Unmoderated testing appears to provide a cost effective alternative for gathering a lot more usability data with considerably less effort. Additional time is required to filter invalid data such as unrealistically short task times.[Read More]