Gage R&R for Non-Destructive and Destructive Test Methods
(Revised May 2016)
Gage R&R analysis is a common technique for analyzing “how good” your measurement system is. The R&R stands for repeatability and reproducibility. You want a measurement system that can tell the difference between parts or samples from your process – or, at a minimum, tell you if a part is within specifications. A Gage R&R analysis helps you answer these questions.
There are few things to consider when determining how to setup a Gage R&R analysis. First, is your test non-destructive or destructive? With a non-destructive test, the part is not altered during the testing. Different operators can measure the same part over and over. With a destructive test, the part is altered or destroyed during the test. Different operators cannot measure the same part. The next decision is the type of Gage R&R design to use: crossed or nested.
This month’s publication helps you determine what type of Gage R&R design to use.
In this issue:
- Gage R&R Overview
- Selecting a Gage R&R
- Crossed Gage R&R for Non-Destructive Measurement Systems
- Crossed Gage R&R for Destructive Measurement Systems
- Nested Gage R&R Design for Destructive Measurement Systems
- Quick Links
Gage R&R Overview
A Gage R&R study is a designed experiment to study the variation in measurement results. The experiment is design to determine how much variation is due to the test method and how much is due to the operators. This is done by performing measurements on parts from the process.
Repeatability is the "within operator" variation. It measures the variation one operator has when measuring the same “part” (and the same characteristic) using the same test measurement system more than one time. Repeatability is the measurement system error. It is sometimes called the equipment variation.
Reproducibility is the "between operators" variation. It is the variation due to different operators when measuring the same characteristic on the same part using the same measurement system. It is sometimes call the operator variation.
Selecting a Gage R&R Design
Figure 1 lays out how to select the appropriate Gage R&R design.
Figure 1: Selecting a Gage R&R Design
The first question deals with if the measurement system is non-destructive or destructive. If it is non-destructive, then the parts are not altered during testing. In this case, you use a crossed Gage R&R design. In this type of design, you select a number of parts from the process (e.g., ten parts) and each operator tests each part multiple times.
If the part is altered during testing, then the measurement system is destructive. You cannot just select parts from the process and have each operator test each part. The part is altered or destroyed, so each part can only be tested one time by one operator. At this point, you have to begin to think about “batches.”
To conduct a gage R&R for a destructive measurement system, you have to make a critical assumption. You have to assume that you are able to identify a batch of parts where the parts are so close to being alike that you can reasonably assume that the parts in the batch are the “same.” You are making the assumption that the batch is homogeneous. If you measure any part of the batch for the same characteristic, you will get the same result in the perfect world.
The next question for the destructive measurement system involves the number of parts in each batch. Are there enough parts in each batch so that each operator in the study can run at least two parts from each batch? For example, suppose you are measuring the hardness of a steel bar and would like to do a Gage R&R on the hardness tester. You consider each bar to be a batch. You can cut the bar into 10 pieces to be tested for hardness. Each of these pieces is considered to be the same. Suppose you have three operators and you want each operator to test two pieces per batch. You need 6 pieces per bar to do this. So, you have enough pieces for each operator to test pieces from each batch. In this case, you use a crossed Gage R&R design.
Now suppose you were using 6 operators and wanted each operator to test 2 pieces per batch. This requires 12 pieces per batch, but each batch (bar) only provides 10 pieces. Since there are not enough pieces per batch, you will have to setup the design so each operator measures 2 pieces from a unique batch (bar). This is the nested Gage R&R design.
These designs are described in more detail below.
Crossed Gage R&R Design for Non-Destructive Measurement Systems
A part or sample is not altered during a non-destructive gage R&R. For example, if you are measuring the length of a part, that part is not changed during the measurement. To perform a non-destructive gage R&R, you must decide on the following for the study:
- The number of operators
- The number of parts
- The number of trials
For example, you may decide to use 2 operators, 3 parts and 2 trials. This means that operator 1 will measure each of the 3 parts 2 times. Operator 2 will measure the same 3 parts 2 times. In this example, there will be a total of twelve measurement results. This type of experiment is called a “crossed” gage R&R because each operator tests each part. The experimental layout is shown below in Figure 2.
Figure 2: Crossed Gage R&R for Non-Destructive Measurement System
Figure 2 shows the 2 trials for part 1 that Operator 1 runs. Suppose Operator 1 gets the following tests results for the two trials: 0.29 and 0.41. The results are not the same. Not surprising. Everything varies. The first question to ask is
What are the sources of variation in these two numbers?
The part is the same. The operator is the same. The variation is simply a measure of how well one operator can repeat the test on same part. So, the source of variation in these number is how repeatable the test method is – the repeatability. It is a measure how close the operator is to getting the same result each time he measures the same part. Each set of trials for each part, under each operator, gives another estimate of the repeatability.
Reproducibility is the variation in the average results for different operators. It will also include the interaction between operators and parts if it is significant. The part-to-part variation examines the variation in part averages. You hope that the part-to-part variation accounts for the vast majority of the variation in the results and that repeatability and reproducibility account for very little of the variation.
There are two methods commonly used to analyze the results of a crossed gage R&R:
- Average and range method
- Analysis of variance (ANOVA)
More recently, Dr. Donald Wheeler’s “EMP” (evaluating the measurement system) is becoming the preferred way to perform a Gage R&R analysis.
All these analysis methods have been covered in previous newsletters on measurement systems analysis.
Crossed Gage R&R Design for Destructive Gage Measurement Systems
Each part is altered or destroyed with a destructive measurement system. So, each operator cannot measure the same part multiple times. As discussed above, this is where you have to make a critical assumption. You have to assume that you are able to identify a batch of material that is so close to the same that you can reasonably assume that the parts in the batch are the “same.” You are making the assumption that the batch is homogeneous.
For example, suppose you make powdered product like polyvinyl chloride (PVC). You take a one-pound “batch” of PVC from the final product silo. You want to test the material for inherent viscosity. The sample you test is destroyed during the testing. You can mix the sample very well and assume that the batch is homogeneous. Thus, the samples from this one-pound batch are the “same.”
The next question you must consider is the design setup. If all the operators can measure parts from each batch, then you can use the crossed Gage R&R described above. Figure 3 shows this design setup.
Figure 3: Crossed Gage R&R for Destructive Measurement Systems
In this design, you have 2 operators measuring 2 parts from 2 batches. There are at least 4 parts per batch so a crossed design can be use. Operator 1 measures parts 1 and 2 from batch 1 while Operator 2 measures parts 3 and 4 from batch 1. These parts are different parts – but the assumption is that they come from a homogenous batch of material. Likewise, operator 1 measures parts 1 and 2 from batch 2 and Operator 2 measures parts 3 and 4 from batch 2. These are different parts from a different batch – but batch 2 is considered to be homogenous., i.e., the parts in batch 2 are the same.
What causes variation in the results between part 1 and part 2 in the design shown in Figure 3? It is the same test and the same operator – similar to the crossed Gage R&R explained above where the difference is due to the measurement system repeatability. But unlike the crossed design, the same part is not being tested. We are assuming that the parts are the same since they come from a homogeneous batch. In reality, the difference is due to the measurement system repeatability and the within-batch variation. The assumption is that the batch is homogeneous and that the within-batch variation should be small. If a large amount of variation comes from part 1 and part 2 results, then you should question whether you really have a homogeneous batch.
Nested Gage R&R Design for Destructive Measurement Systems
This situation is the same as for the crossed Gage R&R for destructive measurement systems until you get to the point of determining if there are sufficient parts from each batch for each operator to test. If there are, as shown above, you use the crossed Gage R&R design.
But, if there are not sufficient parts in each for each operator to test multiple times, then you must use a nested Gage R&R design. Figure 4 shows how a nested R&R design for destructive measurement systems is laid out.
Figure 4: Nested Gage R&R
Suppose that each homogenous batch only contains two parts. There are not sufficient parts in each batch for the both operators to test. In this case, only one operator will test the two parts in a single batch. Each operator will test different parts in different batches. So, Operator 1 will test the two parts in Batch 1 and Batch 2. Operator 2 will test the two parts in Batch 3 and Batch 4.
When operator 1 runs the two parts in batch 1, what the sources of variation present? Again, it is the same operator. And we are assuming that parts 1 and 2 are essentially the same. So, this is estimating the repeatability of the test method. But it also contains the within-batch variability. This is true for destructive tests whether you use the crossed or nested Gage R&R design.
ANOVA is used to analyze the results of a nested gage R&R for destructive measurement systems. The average and range method cannot be used. We will look at how this done next month.
This newsletter has shown the differences in setting up a gage R&R study for non-destructive testing and a gage R&R for destructive testing. For non-destructive measurement systems, you will always use the crossed Gage R&R design because each operator can test each part multiple times. With the destructive measurement systems, you have to be able to define batches that are homogeneous – batches where the parts are considered to be the “same.” You will use the crossed Gage R&R analysis if each operator can test multiple parts from each batch. However, if there are not enough parts in each batch to accomplish this, you will use the nested Gage R&R design.
Thanks so much for reading our publication. We hope you find it informative and useful. Happy charting and may the data always support your position.
Dr. Bill McNeese
BPI Consulting, LLC
Connect with Us
Measurement Systems Analysis
- << Return to Categories
- A Tale of Two Precision to Tolerance Ratios
- ANOVA Gage R&R - Part 1
- ANOVA Gage R&R - Part 2
- ANOVA Gage R&R - Part 3
- Acceptance Criteria for Measurement Systems Analysis (MSA)
- Attribute Gage R&R Studies - Part 2
- Attribute Gage R&R Studies: Comparing Appraisers
- Destructive Gage R&R Analysis
- Evaluating the Measurement Process (EMP) Overview
- Evaluating the Measurement Process - Part 1
- Evaluating the Measurement Process - Part 2
- Five Common Mistakes with Gage R&R Studies
- Gage R&R for Non-Destructive and Destructive Test Methods
- How Does Measurement Variation Impact Control Chart Signals?
- Individuals Control Charts and Levey- Jennings Charts
- Levey-Jennings Charts
- Measurement Systems - Is Yours Any Good?
- Monitoring Destructive Test Methods
- Monitoring Test Methods Using SPC
- Operational Definition of a Consistent Measurement System
- Operational Definitions/Measurement System Analysis
- Operator-Part Interaction in Gage R&R Studies
- Probable Error and Your Measurement System
- SPC and the Lab
- Specifications and Measurement Error
- The Calculations Behind a Gage Linearity Study
- The Impact of Measurement Error on Control Charts
- The Short EMP Study
- Three Methods to Analyze Gage R&R Studies
- Variable Measurement Systems - Part 1: Stability
- Variable Measurement Systems - Part 2: Bias
- Variable Measurement Systems - Part 3: Linearity
- Variable Measurement Systems - Part 4: Gage R&R
SPC Knowledge Base
Click here to see what our customers say about SPC for Excel!
SPC Around the World
SPC for Excel is used in 80 countries internationally. Click here for a list of those countries.