Measuring Usability
Quantitative Usability, Statistics & Six Sigma by Jeff Sauro

Current Usability Solutions are Unpredictable

Jeff Sauro • September 17, 2004

It’s a big step when User Centered Design methods are employed in a company to improve the usability of a product. It shouldn’t be the last step and often times it is. Many popular usability testing techniques are the right method to gather user data, however, their results alone will only scratch the surface of the true state of usability. Often their results can be misleading.

Is the problem you found with that one user when testing the 10 users using Think-Aloud Protocol a problem 1 out of 10 times or 1 out of 100 times? More important, what is to be done with that information? Is a redesign of the screen warranted? Does the scenario match the user’s real goals? With a software product that has thousands of users executing tasks thousands of times over the life of a product, decisions can have drastic impacts for better or worse.

The data may be partially objective, but the solution typically is not. All too often we well intentioned usability practitioners use our intuition to decide how to make the product more usable. Even when that intuition and experience is well informed, without an objective measure it’s hard to tell either way. Currently we’re throwing darts in the dark. Sometimes we hit our target but it’s usually by chance and even if we do we can’t say with much confidence because we can’t even see the dart board.

Rate this Blog

No Ratings Yet

Poor         Excellent
012345678910

.

Posted Comments

There are 1 Comments

November 30, 2010 | Roger Belveal wrote:

A basic auto mechanic knows that if there is air, fuel, and a spark, in right quantity, mixture and timing, the engine should run. It’s amazing to me how, with data before us, many UX people start changing the tires in reckless random efforts to make the thing work. Identifying problems while lacking an understanding of what actually makes an interaction successful isn't all that helpful. 


Post a Comment

Comment:


Your Name:


Your Email Address:


.

To prevent comment spam, please answer the following :
What is 1 + 2: (enter the number)

.
.