Six controversial topics in usability

Jeff Sauro • March 28, 2011

Every field has its set of hot-button issues and usability is no exception. Here are six topics that tend to generate some passionate discussions.

1.    Quantifying usability: Usability is all about the user (i.e. people). Talk of using numbers to describe human computer interaction gets some upset. Usability is typically considered a qualitative activity and not the place for cold-number crunching. Throw some probability and statistics and you've really got some folks going.

2.    Reliability & quality of Usability Evaluators: Ask a group of independent usability professionals to examine an interface and identify the problems.  You'll get a list of problems with only a small overlap.  This has been demonstrated in several comparative usability evaluations.  Should we question the veracity of usability claims? Do such discussions hurt the credibility of the field?

3.    Certification:  Want to call yourself a usability professional? Maybe you should be certified. Will a certification board and process lift the quality of work or just add a layer of bureaucracy that doesn't mean more than the piece of paper it's printed on? 

4.    Unmoderated testing versus lab-based moderated testing:  There are dozens of tools  to collect data from users quickly. Are such tools a threat to practitioners? Can we trust the data?

5.    Effectiveness of Heuristic Evaluations: Does the method of having a usability expert review an interface against a set of heuristics do more harm than good?  Are heuristic evaluations 99% bad? Are such discount-usability methods effective or should they be cleared off the shelves?

6.    Sample size:  There are few things which generate more controversy that the number of users you need to test in a usability evaluation. Some just say "a lot," others say 5 and others do their best to avoid talking sample sizes all together.  The real answer depends on a few factors but there are solid mathematical ways for finding the optimal sample size for usability tests. Of course, using such methods to find the optimal sample size may get some upset (see controversy 1).

Learn More

Jeff Sauro hosted a live webinar on February 28th, 2012 on Best Practices for Remote Usability Testing. The event was overbooked so if you missed it you can now view a recording.

You Might Also Be Interested In:

Usability Evaluators: Reliable as Radiologists?	6 things you didn't know about Heuristic Evaluations	The Five Most Influential Papers in Usability	Will five users really find 85% of all usability problems?
How to conduct a Quantitative Usability Test Report

Rate this Blog

Avg. Rating 6.38 (16)

Poor										Excellent
0	1	2	3	4	5	6	7	8	9	10

.

Posted Comments

There are 1 Comments

April 13, 2011 | Chris Poteet wrote:

You know what's really a shame? That "interesting" rating system you have for these posts. 

---

Post a Comment

Comment:

Your Name:

Your Email Address:

.

To prevent comment spam, please answer the following :
What is 1 + 2: (enter the number)