Measuring Usability
Quantitative Usability, Statistics & Six Sigma by Jeff Sauro

A Brief History of Usability

Jeff Sauro • February 11, 2013

The profession of usability as we know it largely started in the 1980s. 

Many methods have their roots in the earlier fields of Ergonomics and Human Factors which began near the beginning of the 20th century and had a strong influence through World War II. 

While not exhaustive, the following is a timeline of several key events, people and publications that have shaped the history and future of usability:

1911
Frederick Taylor publishes Principles of Scientific Management which describes time and motion studies and methods for improving industrial efficiency.

1916
Frank and Lillian Gilbreth reduce work motions into smaller steps and pioneer ways of making work faster and easier from bricklaying to clerical work. They applied this method during World War I by showing soldiers how to assemble and disassemble weapons in the dark. 

1936
  The Palm Beach Post publishes an advertisement for a new Frigidaire highlighting usability as one of its features.

1943
Alphonse Chapanis, a lieutenant in the U.S. Army, shows that "pilot error" can be greatly reduced through the more intuitive layout of airplane cockpits.

1947
John E Karlin at Bell Labs is named head of the newly-formed User Preference Department (later renamed the Human Factors department) where he would help perfect the modern numeric dialing system and keypad still in use today.

  He conducted a famous study to find out how short AT&T could make phone cords. At night he went into offices at the labs and shortened phone cords until staff members called technical support staff complaining that their cords were too short.

 
1954
Paul Fitts publishes a paper in the Journal of Experimental Psychology that describes a mathematical model used to predict the time it takes to move to a target based on its size and distance (which became known as  Fitts' Law).

1956
The psychologist George Miller coins the phrase "the magic number seven plus or minus two" from a variety of experimental results indicating that humans have trouble holding more than five to nine items (chunks) simultaneously in working memory.

1957
The Human Factors Society is formed.

1967
Micheal Scriven writes about formative and summative evaluations in the education literature as applied to student learning and assessment. These terms would later be applied to different types of usability evaluations.

1979
Permanent Labs at companies like IBM perform what we now would call Summative usability testing.

The first scientific publication with usability in its title appears, "The Commercial Impact of Usability in Interactive Systems" by John Bennett.

1980
Ericson and Simon publish" Verbal Reports as Data" which focuses on using the Think Aloud Method that would later come to dominate usability tests.

Alphonse Chapanis' student, Jeff Kelley, is credited with coining the term "Oz Paradigm" which we now refer to as the "Wizard of Oz" method.

1981
Alphonse Chapanis and colleagues publish "Tutorials for the First-Time Computer User," which describes usability as more of a formative than summative activity.  They suggested that observing about five to six users using the software will reveal most of the problems in a usability test.

1982
Wanting a more precise estimate of a sample size than 5-6, Jim Lewis published the first paper[pdf] describing how the binomial distribution can be used to model the sample size needed to find usability problems. It is based on the probability of discovering a problem with probability "p" for a given set of tasks and user population given a sample size "n."

Clayton Lewis publishes an IBM technical report using Herb Simon's "Thinking Aloud" Method in Cognitive Interface Design.

At Gaithersburg, Maryland professionals interested in human-computer interaction  meet for the first time. The conference is funded jointly by the Human Factors Society and the Association for Computing Machinery (ACM). Later that year, ACM forms a subgroup called the Special Interest Group on Computer-Human Interaction (SIGCHI).

1983
  The Psychology of Human Computer Interaction is published by researchers at Carnegie Mellon and Xerox Park (Stuart Card, Thomas Moran & Allen Newell).

This seminal book explains GOMS and Keystroke Level Modeling based on the earlier work of Taylor, Fitts and Gilbreth.


The first CHI Conference was held in Boston as part of ACM's SIGCHI subgroup.

1984
   Apple introduces the Macintosh during the 1984 Super Bowl, making the case that ease of use sells.


Smith and Moser publish 997 guidelines for "Designing User Interface Software."

The Human Factor, by Harry Hersh and Dick Rubinstein, both at Digital Equipment Corporation, is published.  It is the first book-length description of human-computer interaction.

1985
J. Gould and Clayton Lewis publish the influential paper, "Designing for Usability: Key Principles and What Designers Think.[pdf]." They discuss an early and continual focus on users as well as empirical measurement and iterative design.

Computer Usability Testing & Evaluation by Richard Spenser is published

1986
John Brooke at Digital Equipment Corporation creates a "quick and dirty" questionnaire to assess the usability of software.  The System Usability Scale (SUS) has gone on to become the mostly widely used questionnaire for evaluation perceptions of system usability.

The first local chapter of SIGCHI is started in Boston a few months after the annual SIGCHI conference is held there.

1987
 Designing the User Interface (1st edition) by Ben Shneiderman is published. It is now in its fifth edition.


The Questionnaire For User Interaction Satisfaction (QUIS) is published based on the work at Ben Shneiderman's HCI lab at the University of Maryland.

The Birth of the Modern Usability Profession


1988
John Whiteside at Digital Equipment Corporation and John Bennett at IBM published a number of chapters and papers on the topic of "usability engineering" (Whiteside, Bennett, & Holtzblatt,1988) which stressed early goal setting, prototyping and iterative evaluation. Joe Dumas, one of the godfathers of usability, attributes these papers and this period as the birth of usability as a profession.

 Don Norman publishes the Psychology of Everyday Things, which later would be renamed the Design of Everyday Things.


1989
The Technology Acceptance Model (TAM), including a questionnaire to measure perceived usefulness  and usability, is published by Fred Davis [pdf].

1990

Shackel publishes "Human Factors and Usability" which defined usability as a function of efficiency, effectiveness & satisfaction (the ISO 9241 pt 11 standard). Despite many proposed extensions, we still think of usability in terms of these three aspects.

Peter Polson & Clayton Lewis publish several papers on the Cognitive Walkthrough[pdf].

Jakob Nielsen Rolf Molich publish the seminal paper "Heuristic Evaluation of User Interfaces,"  in which they describe this influential discount usability method. 

Robert Virzi details three experiments at the Human Factors and Ergonomics Society Conference replicating earlier work from Nielsen using the binomial formula for deriving sample sizes for usability studies.

1991
The Usability Professionals Association is formed by a group of CHI attendees including Janice James who along with Ginny Redish [pdf] would start the usability special interest group in the Society of Technical Communications

1992
Robert Virzi's paper "Refining the test phase of usability evaluation: How Many Subjects is Enough?[pdf]" is published.  This, along with his previous paper found that :
  1. Additional subjects are less and less likely to reveal new information in a usability test.
  2. The first 4-5 users find ~80% of problems in a usability test (avg. p of .32)
  3. Severe problems are more likely to be detected by the first few users.
Jim Lewis publishes the Post Study System Usability Questionnaire (PSSUQ) [pdf].

1993
 Usability Engineering by Jakob Nielsen is published.
 A Practical Guide to Usability Testing by Joe Dumas & Ginny Redish is published.


Publication of the Software Usability Measurement Inventory(SUMI) questionnaire by Jurek Kirakowski at the University of Cork.

A listserve dedicated to usability is started by Tharon Howard and continues to be a popular discussion outlet to this day.

Usability Matures


1994
 Cost Justifying Usability by Randolph Bias & Deborah Mayhew is published.


Jim Lewis reexamines Virzi's claims in the paper "Sample sizes for usability studies: Additional considerations[pdf]" and finds general support for the claim that additional users are less likely to reveal new information but the sample size is dependent on the problem occurrence. He also found that problem severity and frequency were independent.

 Jeff Rubin publishes "Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests"


1995
Jakob Nielsen publishes the first bi-weekly column on usability on useit.com which continues to this day.

The Usability Professionals' Association holds its first annual meeting in Portland Maine.

1996
John Brooke publishes the System Usability Scale (SUS) after 10 years of use in industry.

WebEx is founded in California and goes on to develop screen sharing and conferencing software that will be used in moderated remote usability testing.

1998
Usability becomes a standard embodied in ISO 9241 pt 11.

"Web Navigation: Designing the User Experience" is published, one of a new wave of books using the term User Experience.

Rolf Molich conducts the first Comparative Usability Evaluation (CUE) study.

Separately, Jacobsen, Hertzum, and John publish the "The Evaluator Effect in Usability Tests[pdf]: Problem Detection & Severity Judgments--the first study document the "evaluator effect."

Gray and Salzman publish "Damaged merchandise? A review of experiments that compare usability evaluation methods.[pdf]"  which provided detailed critiques of the methodologies used to compare discount usability methods like Heuristic Evaluation against Usability Testing.

Agresti and Coull publish the Adjusted-Wald binomial confidence interval in the American Statistician. This interval performs particularly well for small sample studies used extensively in usability research.

2000
 Don't Make me Think by Steve Krug is published which brings usability testing to the masses using the same Think Aloud method from Ericson and Simon from 20 years earlier.


2001
American National Standards Institute (ANSI) develops the Common Industry Format for Usability Test Reports (CIF)

Usability Goes Remote

2002
The first publications about remote usability testing emerge, including the one by Tom Tullis et al on "An Empirical Comparison of Lab and Remote Usability Testing of Web Sites [pdf]


2003
 Observing the User Experience is published.


2006
Methods of automating heretofore expensive and time consuming usability studies using software and crowdsourcing are published.


2008
 Tom Tullis and Bill Albert publish Measuring the User Experience, the first book dedicated to measuring usability, which for the last decade had turned increasingly qualitative.


2010
Beyond the Usability Lab: Conducting Large-Scale User Experience Studies is published.

2012
UPA changes its name to the User Experience Professionals Association (UxPA)

 Sauro and Lewis publish the first book on the statistical analysis of usability data: Quantifying the User Experience: Practical Statistics for User Research



Special Thanks to Joe Dumas and Jim Lewis for contributing and commenting on earlier versions of this timeline. Additional details about the history of usability can be found in papers from Joe Dumas, Jim Lewis, Jonathan Grudin and Ginny Redish.



About Jeff Sauro

Jeff Sauro is the founding principal of Measuring Usability LLC, a company providing statistics and usability consulting to Fortune 1000 companies.
He is the author of over 20 journal articles and 4 books on statistics and the user-experience.
More about Jeff...


Learn More


UX Bootcamp: Aug 20th-22nd in Denver, CO
Best Practices for Remote Usability Testing
The Science of Great Site Navigation: Online Card Sorting + Tree Testing Live Webinar


You Might Also Be Interested In:

Related Topics

Usability
.

Posted Comments

There are 7 Comments

March 5, 2013 | Jacqueline wrote:

What an aweomse way to explain this-now I know everything! 


March 5, 2013 | Mercedesmagdalena wrote:

Saranam my beloved Swamiji.Annamalaiku nigar alaymanaianne(Paramahamsa nithyananda) enbathai ulagame yetru kondathu.. vaalum avathara purusarana engal guru vaalum kalathil nangalum vaalvathai yenni nangalum muguntha perumitham adaigirom antha perumithathutan ungal padangalai vanagugirom. You are the demigod of this cosmos.. Who shining forever in this cosmos as The Avatar.. You are a sacred secret in everything. You are The Cosmic Mother.- ma nithya suparnananda, Tamilnadu. 


March 2, 2013 | click here now wrote:

This website absolutely does render properly on my iphone4 - terrific job 


February 14, 2013 | Katie wrote:

This is so interesting! Thanks! 


February 14, 2013 | aurora font wrote:

Great!! Thank you very much for this splendid post. Congratulations. 


February 13, 2013 | Jeff Sauro wrote:

Thanks Tom, Fixed that one!

Jeff 


February 13, 2013 | Tom Engh wrote:

The reference to the Gilbreth's should be Frank and Lillian, not John and Martha 


Post a Comment

Comment:


Your Name:


Your Email Address:


.

To prevent comment spam, please answer the following :
What is 5 + 4: (enter the number)

Newsletter Sign Up

Receive bi-weekly updates.
[4087 Subscribers]

Connect With Us

UX Bootcamp

Denver CO, Aug 20-22nd 2014

3 Days of Hands-On Training on User Experience Methods, Metrics and Analysis.Learn More

Our Supporters

Use Card Sorting to improve your IA

Loop11 Online Usabilty Testing

Usertesting.com

Userzoom: Unmoderated Usability Testing, Tools and Analysis

.

Jeff's Books

Quantifying the User Experience: Practical Statistics for User ResearchQuantifying the User Experience: Practical Statistics for User Research

The most comprehensive statistical resource for UX Professionals

Buy on Amazon

Excel & R Companion to Quantifying the User ExperienceExcel & R Companion to Quantifying the User Experience

Detailed Steps to Solve over 100 Examples and Exercises in the Excel Calculator and R

Buy on Amazon | Download

A Practical Guide to the System Usability ScaleA Practical Guide to the System Usability Scale

Background, Benchmarks & Best Practices for the most popular usability questionnaire

Buy on Amazon | Download

A Practical Guide to Measuring UsabilityA Practical Guide to Measuring Usability

72 Answers to the Most Common Questions about Quantifying the Usability of Websites and Software

Buy on Amazon | Download

.
.
.