August 2012 This month's newsletter is the first in a multi-part series on using the ANOVA method for an ANOVA

Gage R&R study. This method simply uses analysis of variance to analyze the results of a gage R&R study instead of the classical average and range method. The two methods do not generate the same results, but they will (in most cases) be similar. This newsletter focuses on part of the ANOVA table and how it is developed for the Gage R &R study. In particular it focuses on the sum of squares and degrees of freedom. Many people do not understand how the calculations work and the information that is contained in the sum of squares and the degrees of freedom. In the next few issues, we will put together the rest of the ANOVA table and complete the Gage R&R calculations. In this issue: Sources of Variation Example Data The ANOVA Table for Gage R&R The ANOVA Results Total Sum of Squares and Degrees of Freedom Operator Sum of Squares and Degrees of Freedom Parts Sum of Squares and Degrees of Freedom Equipment (Within) Sum of Squares and Degrees of Freedom Interaction Sum of Squares and Degrees of Freedom Summary Quick Links Any gage R&R study is a study of variation. This means you have to have variation in the results. On occasion, I get a phone call from a customer wondering why their Gage R&R study is not giving them any useful information. And, in looking at the results, I discover that each result is the same - for each part and for each operator. There is no variation. I am asked - Isn't it good that there is no variation in the results? No, not in a gage R&R study. It means that the measurement process cannot tell the difference between the samples. So remember, a gage R&R study is a study in variation - this means that there must be variation. If you are not familiar with how to conduct a Gage R&R study, please see our December 2007 newsletter. This newsletter also includes how to analyze the results using the average and range method. As usual, please feel free to leave comments at the end of the newsletter.

Sources of Variation

Suppose you are monitoring a process by pulling samples of the product at some regular interval and measuring one critical quality characteristic (X). Obviously, you will not always get the same result when measure for X. Why not? There are many sources of variation in the process. However, these sources can be grouped into three categories: variation due to the process itself variation due to sampling variation due to the measurement system These three components of variation are related by the following: where t2 is the total process variance; p2 is the process variance; s2 is the sampling variance and ms2 is the measurement system variance. Note that the relationship is linear in terms of the variance (which is the square of the standard deviation), not the standard deviation. For our purposes here, we will ignore the variance due to sampling (or more correctly, just include it as part of the process itself). However, for some processes, sampling variation can greatly impact the results. Thus, we will consider the total variance to be: Remember geometry? The right triangle? The Pythagorean Theorem? The above equation can be represented by the triangle below.

The total standard deviation, t, for a measurement is equal to the length of the hypotenuse. The process standard deviation, p, is equal to the length of one side of the triangle and the measurement system standard deviation, ms, is equal to the length of the remaining side. You can easily see from this triangle what happens as the variation in the product and measurement system changes. If the product standard deviation is larger than the measurement standard deviation, it will have the larger impact on the total standard deviation. However, if the measurement standard deviation becomes too large, it will begin to have the largest impact. Thus, the objective of improving a measurement system is to minimize the % variance due to the measurement system: % Variance due to measurement system = 100(ms2/t2)

The gage R&R study focuses on ms2. In a gage R&R study, you can break down ms2 into its two components: chart below shows the results by part by operator.

Interaction Sum of Square and Degrees of Freedom

We will make use of the equality stated earlier to find the interaction sum of squares. This equality was: SST = SS0 + SSP + SS0*P + SSE SS0*P = SST- (SS0 + SSP + SSE) SS0*P = 32.317 - (1.63 + 28.909 + 1.712) SS0*P = 0.065 The same equality holds for the degrees of freedom: df0*P = dfT - (df0 + dfP + dfE) df0*P =44 - (2 + 4 + 30) df0*P = 8

Summary
This is the first of a multi-part series on using ANOVA to analyze a Gage R&R study. It focused on providing a detailed explanation of how the calculations are done for the sum of squares and degrees of freedom. We will finish out the ANOVA table as well as complete the Gage R&R calculations in the coming issues.

Quick Links
Visit our home page SPC for Excel Software Online Videos of How the SPC for Excel Software Works

Measurement Systems Analysis (Gage R&R) Software Customer Complaint SPC Software SPC Training Complete Teaching Guides SPC PowerPoint Training Modules You Can Customize SPC Implementation Special Offers Ordering Information

September 2012

This month's newsletter is the second in a multi-part series on using the ANOVA method for a Gage R&R study. This method simply uses analysis of variance to analyze the results of a gage R&R study instead of the classical average and range method. The two methods do not generate the same results, but they will (in most cases) be similar. With the ANOVA method, we will break down the variance into four components: parts, operators, interaction between parts and operators and the repeatability error due to the measurement system (or gage) itself. The first part of this series focused on part of the ANOVA table. We took an indepth look at how the sum of squares and degrees of freedom were determined. Many people do not understand how the calculations work and the information that is contained in the sum of squares and the degrees of freedom. In this issue we will

complete the ANOVA table and show how to determine the % of total variance that is due to the measurement system (the % GRR). The second column is the degrees of freedom associated with the source of variation. The third column is the sum of squares. The calculations with these two columns were covered in the first part of this series. The fourth column is the mean square associated with the source of variation. The mean square is the estimate of the variance for that source of variability (not necessarily by itself) based on the amount of data we have (the degrees of freedom). So, the mean square is the sum of squares divided by the degrees of freedom. We will use the mean square information to estimate the variance of each source of variation this is the key to analyzing the Gage R&R results. The fifth column is the F value. This is the statistic that is calculated to determine if the source of variability is statistically significant. It is based on the ratio of two variances (or mean squares in this case).

The ANOVA Table Results

The data was analyzed using the SPC for Excel software. The results for the ANOVA table are shown below. Source Operator Part Operator by Part Equipment Total df 2 4 8 30 44 SS 1.630 28.909 0.065 1.712 32.317 MS 0.815 7.227 0.008 0.057 F 100.322 889.458 0.142 p Value 0.0000 0.0000 0.9964

Note that there is an additional column in this output the p values. This is the column we want to examine first. If the p value is less than 0.05, it means that the source of variation has a significant impact on the results. As you can see in the table, the operator by part source is not significant. Its p value is 0.9964. Many software packages contain an option to remove the interaction if the p value is above a certain value most often 0.25. In that case, the interaction is rolled into the equipment variation. We will keep it in the calculations here though it has little impact since its mean square is so small. The next column we want to look at is the mean square column. This column is an estimate of the variance due to the source of variation. So, MSOperators = 0.815 MSParts = 7.227 MSOperators*Parts = 0.008 MSEquipment = 0.057 You might be tempted to assume, for example, that the variance due to the operators is 0.815. However, this would be wrong. There are other sources of

variation present in all put one of these variances. We must use the Expected Mean Square to find out what other sources of variation are present. We will use 2 to denote a variance due to a single source.

Expected Mean Squares

As stated above, the mean square column contains a variance that is related to the source of variation in the first column. To find the variance of each source of variation, we have to use the expected mean square (EMS). The expected mean square represents the variance that the mean square column is estimating. There are algorithms that allow you to generate the expected mean squares. This is beyond the scope of this newsletter. So, we will just present the expected mean squares. Lets start at the bottom with the equipment variation. This is really the within variation (also called error). It is the repeatability portion of the Gage R&R study. The expected mean square for equipment is the repeatability variance. The repeatability variance is the mean square of the equipment from the ANOVA table.

Now consider the interaction expected mean square which is given by:

Note that the EMS for the interaction tern contains the repeatability variance as well as the variance of the interaction between the operators and parts. This is what is estimated by the mean square of the interaction. The parts expected mean square is shown below.

Note that the EMS for parts contains the variances for repeatability, the interaction and parts. This is what is estimated by the mean square for parts. And last, the expected mean square for the operators is given by:

The EMS for operators contains the variances for repeatability, the interaction and operators. This is what the mean square for operators is estimating.

The Variances of the Components

We can solve the above equations for each individual 2. Repeatability is already related directly to the mean square for equipment so we dont need to do anything there. The other three can be solved as follows:

We can now do the calculations to estimate each of the variances.

Note that the value of the variance for the interaction between the operators and parts is actually negative. If this happens, the variance is simply set to zero.

% Gage R&R
The Measurement Systems Analysis manual published by AIAG (www.aiag.org) provides the following definition: The measurement system variation for repeatability and reproducibility (or GRR) is defined as the following: GRR2=EV2 + AV2 where EV is the equipment variance and AV is the appraiser (or operator) variance. Thus:

The total variance is the sum of the components:

We can use the total variance to determine the % contribution of each source to the total variance. This is done by dividing the variance for each source by the total variance. For example, the % variation due to GRR is given by:

The results for all the sources of variation are shown in the table below. Source Variance % of

GRR Equipment (Repeatability) Operators (Reproducibility) Interaction Parts Total

0.1109 0.0571 0.0538 0.0000 0.8021 0.9130

Total Variance 12.14% 6.25% 5.89% 0.00% 87.86% 100.00%

Based on this analysis, the measurement system is responsibility for 12.14% of the total variance. This may or may not be acceptable depending on the process and what your customer needs and wants. Note that this result is based on the total variance. It is very important that the parts you use in the Gage R&R study represent the range of values you will get from production. One of the major problems people have with Gage R&R studies is selecting samples that do not truly reflect the range of production. If you have to do that, you can begin to look at how the results compare to specifications. We will take a look at that next month as we compare the ANOVA method to the Average and Range method for analyzing a Gage R&R experiment. You could also use a variance calculated directly from a month's worth of production in place of the total variance in the analysis.

Summary
In this newsletter, we continued our exploration of the using ANOVA to analyze a Gage R&R experiment. We completed the ANOVA table, presented the expected mean squares and how to use those to estimate the variances of the components, and showed how to determine the %GRR as a percent of the total variance. In the next newsletter, we will compare the ANOVA method to the Average and Range method for Gage R&R.

Quick Links