Applying the Out of Control Tests
(Note: all the previous publications in the control chart basics category are listed on the right-hand side. Select "Return to Categories" to go to the page with all publications sorted by category. Select this link for information on the SPC for Excel software.)
You have constructed your control chart. You are ready to interpret it – to ask the question:
“What is this control chart telling me about my process?”
There are 8 basic out of control tests you can use. Just one problem. All 8 tests don’t apply to each control chart. So, which tests apply to which control charts? This month’ publication answers that question.
Here is the key to effectively using control charts – the control chart is the way the process communicates with you. Through the control chart, the process will let you know if everything is “under control” or if there is a problem present. Potential problems include large or small shifts, upward or downward trends, points alternating up or down over time and the presence of mixtures. Applying the correct tests to interpret your chart will help you figure out what the control chart is trying to tell you.
In this issue:
You may also download a pdf copy of this publication at this link. Please feel free to leave a comment at the end of the publication.
Out of Control Tests Review
One of our publications examined the 8 rules that you can use to help you interpret what your control chart is communicating to you. These rules help you identify when the variation on your control chart is no longer random, but forms a pattern that is described by one or more of these eight rules. These patterns give you insights into what may be causing the “special causes” – the problem in your process. Part of that publication is used in this review.
If a process is in statistical control, most of the points will be near the average, some will be closer to the control limits and no points will be beyond the control limits. The 8 control chart rules listed in Table 1 give you indications that there are special causes of variation present. Again, these represent patterns.
Table 1: Control Chart Rules
One or more points beyond the control limits
2 out of 3 consecutive points in Zone A or beyond
4 out of 5 consecutive points in Zone B or beyond
7 or more consecutive points on one side of the average (in Zone C or beyond)
7 consecutive points trending up or trending down
8 consecutive points with no points in Zone C
15 consecutive points in Zone C
14 consecutive points alternating up and down
It should be noted that the numbers can be different depending upon the source. For example, some sources will use 8 consecutive points on one side of the average (Zone C test) instead of the 7 shown in the table above. But they are all very similar. Figures 1 through 3 illustrate the patterns. Figure 1 shows the patterns for Rules 1 to 4.
Figure 1: Zone Tests (Rules 1 to 4)
Rules 1 (points beyond the control limits) and 2 (zone A test) represent sudden, large shifts from the average. These are often fleeting – a one-time occurrence of a special cause – like the flat tire when driving to work.
Rules 3 (zone B) and 4 (Zone C) represent smaller shifts that are maintained over time. A change in raw material could cause these smaller shifts. The key is that the shifts are maintained over time – at least over a longer time frame than Rules 1 and 2.
Figure 2: Rules 5 and 6
Figure 2 shows Rules 5 and 6. Rule 5 (trending up or trending down) represents a process that is trending in one direction. For example, tool wearing could cause this type of trend. Rule 6 (mixture) occurs when you have more than one process present and are sampling each process by itself. Hence the mixture term. For example, you might be taking data from four different shifts. Shifts 1 and 2 operate at a different average than shifts 3 and 4. The control chart could have shifts 1 and 2 in zone B or beyond above the average and shifts 3 and 4 in zone B below the average – with nothing in zone C.
Figure 3 shows rules 7 and 8. Rule 7 (stratification) also occurs when you have multiple processes but you are including all the processes in a subgroup. This can lead to the data “hugging” the average – all the points in zone C with no points beyond zone C.
Figure 3: Rules 7 and 8
Rule 8 (over-control) is often due to over adjustment. This is often called “tampering” with the process. Adjusting a process that is in statistical control increases the process variation. For example, an operator is trying to hit a certain value. If the result is above that value, the operator makes an adjustment to lower the value. If the result is below that value, the operator makes an adjust to raise the value. This results in a saw-tooth pattern.
Rules 6 and 7, in particular, often occur because of the way the data are subgrouped. Rational subgrouping is an important part of setting up an effective control chart. A previous publication demonstrates how mixture and stratification can occur based on the subgrouping selected. These rules represent different situations – patterns- on a control chart. It should be noted that not all rules apply to all types of control charts. Table 2 summaries the rules by the type of pattern.
Table 2: Rules by Type of Pattern
Large shifts from the average
Small shifts from the average
Out of Control Tests by Control Chart
The table below shows which out of control tests apply to which control charts.
Table 3: Out of Control Tests by Control Chart
|Control chart||Beyond Limits||Zone A||Zone B||Zone C||Trend||Mixture||Strat.||Over-control|
|Subgroup Averages (X)||x||x||x||x||x||x||x||x|
|Subgroup Ranges (R)||x||x||x||x|
|Subgroup Standard Deviations (s)||x||x||x||x|
|Moving Range (mR)||x||x||x||x|
|Non-Normal Individuals (X)||x|
|Moving Average (X)||x|
The zones tests along with the tests for mixture and stratification are based on having a somewhat symmetrical distribution (e.g., normal). The X chart usually meets this requirement since subgroup averages tend to be normally distributed as the subgroup size increases (central limit theorem). The individuals chart may or may not meet this symmetrical requirement. Care should be taken in applying the zones tests to individual values if the distribution is skewed heavily. You may get some false signals.
The moving range chart reuses data. With a moving range of 2, each point is used twice (except the first point) in calculating the moving range. When applying the Zone C test, you need to increase the number in a row above or below the average to account for this. The same is true for the trend test. If the X chart is using 7 points in a row for zone C, the moving range could be set to (2)(7)-1 = 13.
One major point still needs to be made. You know your process. Look at the control chart. Does something look odd to you even though none of the above tests are violated? If so, there is probably something going on the process. Check it out.
This publication looked at which out of control tests apply to which control charts when identifying the presence of a special cause of variation. Not all 8 tests apply to all control charts.
Thanks so much for reading our publication. We hope you find it informative and useful. Happy charting and may the data always support your position.
Dr. Bill McNeese
BPI Consulting, LLC
Connect with Us
Control Charts - Basics
- << Return to Categories
- Interpreting Control Charts
- Control Strategies
- Use of Control Charts
- The Impact of Statistical Control
- Selecting the Right Control Chart
- Control Limits - Where Do They Come From?
- The Purpose of Control Charts
- When to Calculate, Lock, and Recalculate Control Limits
- My Process is Out of Control! Now What Do I Do?
- The Estimated Standard Deviation and Control Charts
- Applying the Out of Control Tests
- Control Chart Rules and Interpretation
- Control Charts and the Central Limit Theorem
- Control Charts, ANOVA, and Variation
- How Much Data Do I Need to Calculate Control Limits?
- Three Sigma Limits and Control Charts
SPC Knowledge Base Sign-up
Click here to sign up for our FREE monthly publication, featuring SPC and other statistical topics, case studies and more!
SPC Around the World
SPC for Excel is used in over 60 countries internationally. Click here for a list of those countries.