Top 10 Research-Based Usability Findings of 2010

Jeff Sauro • December 29, 2010

1. 5 Second Usability Tests: Ratings of website usability after only 5 seconds are the same as those after 10 minutes.
   
   
2. Unmoderated Usability Data is Mostly Reliable: Data from remote usability test takers is rather similar to lab based studies except for task-times which differ more substantially.
   
   
3. Cheaters: Around 10% of paid usability testers will cheat on your test by rushing through the questions just to receive the honorarium.
   
   
4. The Geometric Mean works better than the median for reporting the best middle task time for sample sizes less than 25.
   
   
5. Usability accounts for at least 30% of customer loyalty: Net Promoter Scores correlate highly with scores from the System Usability Scale (SUS).
   
   
6. Users Self-Reporting Problems: Users are able to find and report around 50% of the problems usability professionals find. Just asking users to report what problems they encountered, how severe they are and potential fixes can be a cheap and effective complement to other usability activities.
   
   
7. Survey respondents prefer the left-side of the rating scale. The way you order your response options matters. People generally lean toward responses that are on the left-side. If you have more favorable responses (e.g. Strongly Agree) on the left you'll get a slightly inflated score.
   
   
8. Asking users to rate task-ease during a task lowers ratings: If you give users only five seconds to complete a task they will rate the task as much more difficult than those who are given no time limit. Contrast this finding with the 5 seconds tests results which shows that user attitudes about usability are different at the task vs. whole website level.
   
   
9. Making survey questions more extreme will generate more disagreement: Scores will be higher if questions are all extremely negatively worded and scores will be lower if all the questions are extremely positively worded.
   
   
10. Usability problems are almost 10-times more common on business applications than on websites
    

Learn More

Jeff Sauro hosted a live webinar on February 28th, 2012 on Best Practices for Remote Usability Testing. The event was overbooked so if you missed it you can now view a recording.

You Might Also Be Interested In:

25 Resources for Measuring Usability

97 Things to Know about Usability

Rate this Blog

Avg. Rating 6.63 (27)

Poor										Excellent
0	1	2	3	4	5	6	7	8	9	10

Related Topics

Usability

.

Posted Comments

There are 3 Comments

January 14, 2011 | DaniellePS wrote:

Awesome summary - I'm sharing it ;) 

---

January 6, 2011 | Ian T wrote:

So why is your rating scale set up with "poor" on the left side? (Great article. I learned a lot!) 

---

January 6, 2011 | Mona Patel wrote:

Hi Jeff! Very cool--great summary! 

---

Post a Comment

Comment:

Your Name:

Your Email Address:

.

To prevent comment spam, please answer the following :
What is 3 + 2: (enter the number)