Measuring Usability
Quantitative Usability, Statistics & Six Sigma by Jeff Sauro

Browse Content by Topic

Usability Testing (19)

Sample Size (18)

UX (12)

Task Time (11)

Survey (11)

Usability (11)

SUS (11)

Questionnaires (9)

Usability Problems (9)

Rating Scale (8)

Net Promoter Score (7)

Statistics (7)

Remote Usability Testing (7)

Usability Metrics (6)

Problem Discovery (6)

Satisfaction (6)

Confidence Intervals (5)

Task Completion (5)

Formative Testing (3)

Regression Analysis (3)

User Research (3)

Summative (3)

Loyalty (3)

Heuristic Evaluation (3)

SUPR-Q (3)

Margin of Error (2)

Credibility (2)

Card Sorting (2)

Qualitative (2)

Information Architecture (2)

Sampling (2)

Crowdsourcing (2)

Clicks (2)

PhD (2)

Benchmarking (2)

Mobile Usability Testing (2)

SEQ (2)

Keystroke Level Modeling (2)

Problem Severity (2)

Cognitive Walkthrough (2)

Task Times (1)

Task Failure (1)

Salaries (1)

Ordinal (1)

Completion Rate (1)

Z-score (1)

UI Disasters (1)

Interval (1)

Marketing (1)

Top Box Scoring (1)

Monte Carlo (1)

Return on Investment (1)

Ethonographic Research (1)

Geometric Mean (1)

Key Drivers (1)

Median (1)

Methods (1)

Evidence Based Design (1)

A/B Testing (1)

iPhone (1)

Analytics (1)

Lean UX (1)

Correlation (1)

Errors (1)

Reliability (1)

Think Aloud (1)

Post-Task Ratings (1)

Quality Assurance (1)

SUS Topics


Predicting Net Promoter Scores from System Usability Scale Scores

Predicting Net Promoter Scores from System Usability Scale Scores

Guest Post By Jim Lewis • January 3, 2012

System Usability Scale (SUS) scores are often collected along with Net Promoter Scores in evaluations of software and website usability. An examination of 81 datasets from 2200 users shows that dividing SUS scores by 10 does a decent job of predicting the Net Promoter Score.[Read More]


Measuring Usefulness

Measuring Usefulness

Jeff Sauro • November 1, 2011

A product must be useful and usable to be adopted and both have been shown to predict reported usage. However, perceived usefulness is 1.5 times more important than usability when predicting technology acceptance.[Read More]


How much does the usability test affect perceptions of usability?

How much does the usability test affect perceptions of usability?

Jeff Sauro • May 17, 2011

In measuring perceived usability of five popular websites, a single difficult task will lower post-test usability scores by 8%. This is largely driven by the least experienced users whose scores dropped by almost 20%. A difficult task doesn't appear to affect the most experienced users' attitudes.[Read More]


Are both positive and negative items necessary in questionnaires?

Are both positive and negative items necessary in questionnaires?

Jeff Sauro • April 26, 2011

There is a long tradition of including items in questionnaires that are phrased both positively and negatively to minimize extreme response and acquiescent biases. An analysis of an all positively worded version of the SUS found little evidence for these biases. This suggests response bias effects are small and outweighed by the real effects of miscoding by researchers and misinterpreting by users.[Read More]


Measuring Usability with the System Usability Scale (SUS)

Measuring Usability with the System Usability Scale (SUS)

Jeff Sauro • February 2, 2011

At only 10 items, SUS may be quick to administer and score, but data from over 5000 users and almost 500 different studies suggests that SUS is far from dirty. Its reliability and validity are as high as or higher than commercial questionnaires. Its versatility, brevity and wide-usage means that despite inevitable changes in technology, we can probably count on SUS being around for at least another 25 years.[Read More]


Does prior experience affect perceptions of usability?

Does prior experience affect perceptions of usability?

Jeff Sauro • January 19, 2011

SUS scores from 1100 users from 62 websites showed that repeat users rate the website as 11% more usable than first time users. SUS scores from 800 users of 16 consumer software products showed that the most experienced users (5+ years of experience) also rate the software as 11% more usable than the least experienced users (less than 3 years of experience).[Read More]


5 Second Usability Tests

5 Second Usability Tests

Jeff Sauro • November 9, 2010

System Usability Scale (SUS) Scores from users who had only 5 seconds to assess the usability of a website were statistically indistinguishable from users who had no time limit. Users who had only 60 seconds on a website tend to rate websites as more usable than those who had only 5 seconds or no time limit.[Read More]


That

That's the worst website ever!: Effects of extreme survey items

Jeff Sauro • September 21, 2010

Items in the System Usability Scale (SUS) were rephrased to either all extreme positive or all extreme negative wording and average scores were compared. Users disagree more with items that are worded in the extreme and resulted in significantly different SUS Scores.[Read More]


Can we trust data from professional usability test-takers?

Can we trust data from professional usability test-takers?

Jeff Sauro • February 9, 2010

In a comparative test, satisfaction scores and completion rates from professional usability test-takers were nearly identical to lab-based users. However, time on task data differed significantly and showed much higher variability. For testing websites intended for a general audience the use of professional testers appears to provide mostly reliable data quickly and for a fraction of the price.[Read More]


Can you use the SUS for websites?

Can you use the SUS for websites?

Jeff Sauro • January 18, 2010

The System Usability Scale (SUS) is the most popular standardized usability questionnaire because it's free and short. It was designed over 20 years ago before the web existed. Should it be used on websites?[Read More]


Does better usability increase customer loyalty?

Does better usability increase customer loyalty?

Jeff Sauro • January 7, 2010

I examined the relationship between customer loyalty as measured by the Net Promoter Score (NPS) and System Usability Scale (SUS) questionnaire from several usability tests. I found that perceptions of usability account for about 1/3 of the changes in customer loyalty. Increasing your usability will lead to increased loyalty.[Read More]

Newsletter Sign Up

Receive bi-weekly updates.
[1981 Subscribers]

Connect With Us

Our Supporters

Loop11 Online Usabilty Testing

Use Card Sorting to improve your IA

About Jeff Sauro

Jeff Sauro is the founding principal of Measuring Usability LLC, a company providing statistics and usability consulting to Fortune 1000 companies.
He is the author of over 15 journal articles and 3 books on statistics and the user-experience.
More about Jeff...

.

Jeff's Books

Quantifying the User Experience: Practical Statistics for User ResearchQuantifying the User Experience: Practical Statistics for User Research

The most comprehensive statistical resource for UX Professions (JUST RELEASED)

Buy on Amazon

Excel & R Companion to Quantifying the User ExperienceExcel & R Companion to Quantifying the User Experience

Detailed Steps to Solve over 100 Examples and Exercises in the Excel Calculator and R

Buy on Amazon | Download

A Practical Guide to the System Usability ScaleA Practical Guide to the System Usability Scale

Background, Benchmarks & Best Practices for the most popular usability questionnaire

Buy on Amazon | Download

A Practical Guide to Measuring UsabilityA Practical Guide to Measuring Usability

72 Answers to the Most Common Questions about Quantifying the Usability of Websites and Software

Buy on Amazon | Download

.
.
.