Measuring Usability Homepage
Quantitative Usability, Statistics & Six Sigma by Jeff Sauro
What's a Z-Score and Why Use it in Usability Testing?
by Jeff Sauro | September 17, 2004 :: 2 Related Articles:: 46 Related Questions
How useful was this article?

Avg. Rating: 67 ( 23 ) | 3 Comments


Page Tags

Tag Name#Vote
Process Sigma16
Z-Score16
1.5 Sigma Shift15
DPMO15
test statistic3


New Tag:   


The Power of Z

A common statistical way of standardizing data on one scale so a comparison can take place is using a z-score. The z-score is like a common yard stick for all types of data. Each z-score corresponds to a point in a normal distribution and as such is sometimes called a normal deviate since a z-score will describe how much a point deviates from a mean or specification point.

In Six Sigma parlance, z-score and process sigma are used interchangeably and are sometimes called z-equivelents. Strictly speaking, the process sigma and z-equivalents are loosely tied to the statistical z-score. The statistical z-score has very strict definitions derived from the rules of the normal distribution. For most applications in Six Sigma, ignoring some of those constraints is innocuous. In usability testing the benefit of the standardization from process sigmas allow us to meaningfully compare disparate measures like task completion and time on task.

The z-score/process sigma is calculated by subtracting your sample mean from a target data point and dividing by the target standard deviation. This value is a measure of the distance in standard deviations of a sample from the mean and is expressed using the Greek letter σ. If your sample is 3 standard deviations from the spec limit, you would describe your process as 3 sigma. or 3σ

The further away a sample is from the spec limit the higher the z-score and process sigma. A higher process sigma means a less defective process. The term Six Sigma originates from the z-score. 6σ means that six standard deviations lie between the mean of a sample and the nearest specification limit. To visualize the Z-score see the Interactive Graph of the Standard Normal Curve

Each process sigma has two equivalent values which provide a meaningful way to compare data and understand how defective a process is:

  1. DPMO: Each expresses the probability of a defect in terms of a defect per million opportunities or DPMO. That is, if a condition were to occur one million times, how many times out of that one million would a defect occur? A process sigma of .5 is equal to 308,000 defects per million opportunities. And a process sigma of 2.5 means that 6,210 out of 1 million times there will be a defect. For a sample that is 6σ, the DPMO is .0.001. Some organizations prefer to think in terms of defects per opportunities instead of the more abstract "standard deviations above the spec limit."
  2. Probability of a Defect: The process sigma can also be described in terms of a probability of a defect. A z-score of .5 means there is a 30% probability of encountering a defect. A z-score of .25 means there is a 40% probability of a defect. For a sample that is 6σ, the probability of a defect is .0000001%. Note: Values do not include a 1.5σ shift.

Why use a Process Sigma?

The process sigma is helpful in three ways:

  1. It allows you to compare disparate types of data (seconds, which are a continuous measurement with task completion which is binary with errors which are discrete count data)
  2. It provides you with a probability of a defect
  3. You can meaningfully compare two different products or processes:
    1. The process sigma for one release of a software product can be compared to subsequent versions
    2. You can compare two different products’ process sigmas
    3. You can compare one module of the same product with a different module on the same product
    4. You can use the properties of the normal distribution to aide in assessing and improving your data set.


If you'd like an email when a new article or calculator is posted sign up for Email Updates.



 
Related Articles
How Do You Calculate a Z-Score/ Sigma Level?
Calculating a Sigma Level from Task Success


 
Related Questions

Ask a Question
Between what two values of Z will 88% of the middle data values fall between?
What is the z value for 1.648?
The variable Z has a standard Normal distribution. a) Find the number z that has cumulative proportion 0.85. b) Find the number z such that the event Z
My local coffee house sells Colombian coffee beans to supermarkets in bags labelled 100g each. The tolerance of the automatic filling machine, leads to weights of bags being approximately Normally distributed with standard deviation 5g. The target mean weight is set at 106g (i.e. the filling machine is set at 6% overfill). Find the percentage of bags which are below the labelled weight. Show the z-score. How do i work this out?
How do you find a z score such that 8% of the area under the curve is to the right of Z?
Site preparation for new housing developments for tracts of 40 houses is normally distributed with a mean of 250 workdays and a standard deviation of 25 workdays. a.Find the probability that the site will not be completed within 280 days b. The probability that the site is completed in less than 225 workdays or it takes more than 275 workdays
I am conducting a ring test where 6 laboratories were asked to measure protein levels in the same flour sample. I then calculated the z score for each of their results ... z score obtined ranged from 0 to 1.7. Does the higher z score indicate that the laboratories are too far away from the norm and that they need to review their process or their staff (assuming that they are using the same test procedure)??
How unusual is this event (Z-Score)? A department store, on average, has daily sales of $28,707.47. The standard deviation of sales is $1000. On Tuesday, the store sold $34,650.77 worth of goods. Find Tuesday's z score. Was Tuesday an unusually good day?
Joe received a z score of -1.50 on a classroom test. This means that, compared to his classmates, Joe's score was...?
What does a Z-score look like on a graph?
What is the difference between a Z-Scores and Process Sigma?
What does a z value mean?
what is the z-score that corresponds to the 20th percentile of the normal distribution
If last six month average defect rate is 5% then what will be the process Zst score?
Can you please explain the 1.5 sigma shift they use in determining process sigma?
On a scale from 0 to 100, the mean level of economic development among the countries in the world is 65 and the standard deviation is 10. What proportion of countries in the world have economic development scores above 80?
What score would Sandra need to beat 91 percent of her mathematics class? The mean score was 73, and the standard deviation was 12.
With a z score of 1.5, what percentage often scores are above 52 and what percentage of the scores are above 60?
Where can I find a Z score chart ?
Can a z score be calculated by input of a proportion only?
Suppose that the scores of architects on a particular creativity test are normally distributed.What percentage of architects have Z scores. (a) above .10, (b) below .10, (c) above .20, (d) below .20, (e) above 1.10, (f) below 1.10, (g) above -.10, (h) below -.10?
What are the units of z-score?
What percent of the time should this occur? (Z-Score) ?
how does altman build z-score? please send to my email the process of building this score!
Having obtained the z score and then derived the percentage... what does the percentage tell you?
How do you calculate a z-score on discrete data?
How do you calculate a Z-score with a two-sided specification limit? What is the DPMO?
I have a lower spec limit of -0.008 and an uppers spec limit of 0.008. The mean of the data is -0.00306 and standard deviation is 0.003642. What is the z-score and DPMO
The grades on the midterm given in a large managerial stats class are normally distibuted with mean 75 and standard deviation 9. Instructors of this class wants to assign an A to top 10%, B to the next 10%, C to next 10%, D to next 10%, and an F to all scores below the 60th percentile. Find the lowest acceptable score within each established range. For example, the lowest acceptable score for an A is the score at the 90th percentile.
What is the basic formula for the z-score other than table of areas?
a score that is 8 points above the mean corresponds to a z-score=0.05 What is the population standard deviation?
Alexa got 144 on her test which has a mean of 128 and a standard deviation of 34. What is her z-score?
I have a data set where n=20. My problem is to find the score at exactly the 75th percentile assuming normality. I know the formula for z-score, the mean, and the standard deviation. How do I do this problem?
why use 6sigma instead of 5 or 4sigma in calculating process capability
why can you not have a z- score equaling 0/0 ? what is problematic with calcutlating a z-score for a data set of repeated entries?
The mean on this test is 3.5 with a standard deviation of .5. Billy scores 5. What is the standard score?
In a 0ne-tail test (l side) with z score of 1.645, what are the percentages for critical value and non-critical value?
Find the number z that has cumulative proportion 0.8
A z score of 1.04 shows a percentage value of?
what is the value of z score required for a 70% confidence interval?
What is the critical z score for a one tailed test with alpha = .01.
How do you calculate the z score for the raw score of 10 based on the following distribution: 8, 9, 15, 30, 7, 8 ?
Find the probability that a randomly selected adult has an IQ that is less than 130
How do you calculate z-scores from batting averages?
In order to calculate dpmo, why do you need multiply 1 million?
z Scores lenths are measured in centameters, does it have to be converted to a different unit of measurment?
If a distribution of test scores is normal with a mean of 78 and a standard deviation of 11, what percent of the area lies below 60

Ask a Question


Comments
Name
Email Address


To prevent comment spam, please answer the following question before submitting (tags not permitted) :
What is 5 + 1: (enter the number)