Sei sulla pagina 1di 39

Lean Six Sigma Operational - Delegate Workbook

Measurements Systems Analysis

Agenda
1. Is our data Trustworthy? Why is MSA important Accuracy & Precision DMAIC Measurements System Variation Bias, Linearity, Stability, Repeatability, Reproducibility, Calibration, Gauge R&R 2. Variable Gauge R&R Parts, Operators, Variation Is the gauge good? Workshop 3. 4. Attribute Gauge R&R Workshop Appendix Analysis of Variance (ANOVA)

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

Why is MSA Important?


Why Measure?
Verify conformance and assist in continuous improvement.

Whats a System?
Gauge/instrument Operators Part/characteristic Method Environment Tolerance

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

Why is MSA Important?


If you cannot measure you cannot improve! - Genichi Taguchi

Product + Measurement = Perception

?
Dimension
SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

Is our Data Accurate?


Gauge R & R is a means of assessing the repeatability and reproducibility of our measurement systems. Gauge R & R studies are carried out in order to discover how much of the process variation is due to the measurement device and measurement methods.

?
Dimension
SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

DMAIC Improvement Process


Define
Select Project Define Project Objective Form the Team

Measure
Define Measures (ys)

Analyse
Identify Potential xs
C1 C2 C3

Improve
Characterise xs

Control
Control Critical xs
10.2 Upper Control Limit 10.0

y
Effect

Evaluate Measurement System


C4 C5 C6

. .. . . . .. .. .

y=f(x1,x2,..)
Optimise xs
4 1 2 1 2 1 2 1 2 5 1 2 1 2 2 1 2 1 6 1 2 2 1 1 2 2 1 7 1 2 2 1 2 1 1 2

9.8

Lower Control Limit

9.6 1 5 10 15 20

Analyse xs Map the Process Identify Customer Requirements


Run 1 2 1 1 2 2 1 1 2 2 3 1 1 2 2 2 2 1 1

Monitor ys

Determine Process Stability Determine Process Capability


LSL USL

1 2 3 4 5 6 7 8

1 1 1 1 2 2 2 2

y
Set Tolerances for xs Verify Improvement

Select Critical xs xx x x x x
15 20 25 30 35

Validate Control Plan

Identify Priorities Update Project File

Set Targets for Measures

x x x x x
15

LSL

USL

20

25

30

35

Close Project Phase Review

Phase Review

Phase Review

Phase Review

Phase Review

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

Measurement Accuracy & Precision

Measurement is accurate but not precise

Measurement is precise but not accurate

Measurement is accurate and precise


SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

Measurement System Variation


Bias Accuracy Measurement System Variation Linearity

Stability Repeatability Precision Reproducibility

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

Bias
Bias

True Value

Observed Average

Bias is the difference between the observed average of the measurements and the true value.

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

10

Linearity
Measured Value Non-Linearity Gauge is measuring lower than true value at high end

Reference Value

Linearity is the difference in bias values over the expected operating range of the measurement gauge.
SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

11

Linearity and bias study


Open Worksheet: Gagelin.mtw This data is a standard Minitab data set that has been used with permission from the AIAG MSA Manual It represents data from 5 parts selected to span the range of the gauge, which have each been measured 12 times randomly by one operator. Their true values have been established by layout inspection.
SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

12

Linearity and bias study


Stat > Quality Tools > Gage Study > Gage Linearity & Bias Study

Option enter best estimate of process variation, in this case 16.5368.

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

13

Linearity and Bias Study


Gage Linearity and Bias Study for Response
Gage name: Date of study: Reported by: Tolerance: Misc: Gage Linearity Coef SE Coef 0.73667 0.07252 -0.13167 0.01093 0.23954 2.17735

Regression 95% CI

1.0

Data Avg Bias

Predictor Constant Slope S Linearity

P 0.000 0.000

If there is not a linearity problem, the slope should be zero.

R-Sq 71.4% %Linearity 13.2

0.5

0.0

Reference Average 2 4 6 8 10

Gage Bias Bias %Bias -0.053333 0.3 0.491667 3.0 0.125000 0.8 0.025000 0.2 -0.291667 1.8 -0.616667 3.7

P 0.040 0.000 0.293 0.688 0.000 0.000

-0.5

Percent of Process Variation


Percent 10 5 0

13.2% of the process variation is accounted for by the lack of linearity of the gauge.

Bias

-1.0 2 4 6 Reference Value 8 10

Linearity

Bias

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

14

Stability
Stability

Time 1

Time 2

Stability is the variation (differences) in the average over extended periods of time using the same gauge and appraiser to repeatedly measure the same part.
SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

15

Repeatability
Repeatability

Repeatability is the variation between successive measurements of the same part, same characteristic, by the same person using the same gauge.

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

16

Reproducibility
Reproducibility

Operator 1

Operator 2

Reproducibility is the difference in the average of the measurements made by different people using the same instrument when measuring the identical characteristic on the same pieces.

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

17

Measurement System Variation


Bias Accuracy Linearity Stability Repeatability Precision Reproducibility Gauge R&R Calibration

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

18

Calibration
The Bias of a gauge can be assessed by repeat measurements of a known reference unit This can be extended across the operating range of the gauge in a Gauge Linearity Study The Stability of the gauge can be assessed by control charting a reference unit Should not routinely recalibrate, instead if reference unit tests outside the control limits, then re-calibrate If measurement device requires frequent recalibration, attempt to improve stability

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

19

Gauge R & R
Gauge R & R is a means of assessing the repeatability and reproducibility of our measurement systems Gauge R & R studies are carried out in order to discover how much of the process variation is due to the measurement device and measurement methods

?
Dimension
SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

Variable Gauge R&R

SSG06101ENUK - MSA/Issue 1.3/July 2008

10

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

21

Variable Gauge R&R


Requirements: A minimum of two operators (recommend 3 or 4) At least 10 parts which should be chosen to represent the full range of manufacturing variation (it may be acceptable to use fewer parts in some special cases) Each part should be measured two or three times in a random order Operators should not be aware of the previous result when measuring the same part
Part 10 Part 5 Part 4 Part 3 Part 2 Part 1

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

22

Variable Gauge R&R


There are two methods available: 1. Analysis of Variance (ANOVA) 2. X-Bar and R

The ANOVA method is: The recommended approach Takes into account any interactive effect between operator and part

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

11

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

23

Variable Gauge R&R


Part-to-Part Variation Operator Overall Variation Measurement System Variation Repeatability We want the Part-to-Part component to be large!
SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

Reproducibility Operator by part Interaction

24

Variable Gauge R&R - Example


Part 1 1 2 2 3 3 4 4 5 5 6 6 7 7 8 8 9 9 10 10 Operator 1 0.65 0.60 1.00 1.00 0.85 0.80 0.85 0.95 0.55 0.45 1.00 1.00 0.95 0.95 0.85 0.80 1.00 1.00 0.60 0.70 Operator 2 0.55 0.55 1.05 0.95 0.80 0.75 0.80 0.75 0.40 0.40 1.00 1.05 0.95 0.90 0.75 0.70 1.00 0.95 0.55 0.50 Operator 3 0.50 0.55 1.05 1.00 0.80 0.80 0.80 0.80 0.45 0.50 1.00 1.05 0.95 0.95 0.80 0.80 1.05 1.05 0.85 0.80

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

12

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

25

Variable Gauge R&R - Minitab


Open Worksheet: Gauge R&R

The Part numbers being measured Operators performing measurements

Each operator measures each part twice

Individual measurements

In Minitab the data is entered in single columns


SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

26

Variable Gauge R&R - Minitab


Stat>Quality Tools>Gage Study>Gage R& R (Crossed) Enter Part, Operator, Measurement Check ANOVA Method

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

13

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

27

Variable Gauge R&R - Minitab


Two-Way ANOVA Table With Interaction Source Part Operator Part * Operator Repeatability Total DF 9 2 18 30 59 SS 2.05871 0.04800 0.10367 0.03875 2.24913 MS 0.228745 0.024000 0.005759 0.001292 F 39.7178 4.1672 4.4588 P 0.000 0.033 0.000

Gage R&R %Contribution (of VarComp) 10.67 3.10 7.56 2.19 5.37 89.33 100.00

p < 0.05 so all terms significant

Source Total Gage R&R Repeatability Reproducibility Operator Operator*Part Part-To-Part Total Variation

VarComp 0.0044375 0.0012917 0.0031458 0.0009120 0.0022338 0.0371644 0.0416019

Estimates of Variances for each source

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

28

Variance Component Estimates


Part-to-Part Variation 0.0371644 Overall Variation 0.0416019 Measurement System Variation 0.0044375 Repeatability 0.0012917 Reproducibility 0.0031458

Operator 0.0009120

Operator by part Interaction 0.0022338

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

14

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

29

Variable Gage R&R Standard Deviations


This is the gauge standard Study Var %Study Var deviation, R&R = Source StdDev (SD) (6 * SD) (%SV) 0.066615 Total Gage R&R 0.066615 0.39969 32.66 Remember that Repeatability 0.035940 0.21564 17.62 standard Reproducibility 0.056088 0.33653 27.50 deviations are not additive! Operator 0.030200 0.18120 14.81
Operator*Part Part-To-Part Total Variation 0.047263 0.192781 0.203965 0.28358 1.15668 1.22379 23.17 94.52 100.00

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

30

Interpreting the Results


We would like the total measurement system variation (Gauge R&R) to be as small as possible. Calculate the percentage of the process tolerance taken up by the measurement system variation, represented by 6 x the gauge standard deviation. This is known as %Precision/Tolerance or %P/T. The Process Tolerance is equivalent to the difference between the upper and lower specification limits (USL LSL).
%P/T = 100 % R&R Process Tolerance 6

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

15

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

31

Is the Gauge Good?


% P/T (6R&R/Process Tolerance) 0 - 10% 10 - 30% >30% Acceptability Very Good (Six Sigma Gauge) May be Acceptable Probably Not Acceptable

The interpretation will also depend on the current level of process variation
Note that these guidelines are as recommended in Measurement Systems Analysis Third Edition published in March 2002 as part of ISO/TS16949 and developed in conjunction with AIAG.

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

32

Is the Gauge Good?


% R&R If the %P/T is greater than 10%, then a secondary calculation can be used to decide whether the gauge can be used during the DMAIC activity. Comparing R&R to the current process variation indicates whether the measurement device is currently causing a problem. This is known as %R&R. We need an independent estimate of the process (total) variation (the value from the Gauge R&R is based on only a few samples) We would like the measurement standard deviation to be less than the total standard deviation

%R & R =

R& ? R&R R 100%< 50% ? Process (total)


Process (total)
SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

16

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

33

Interpreting the Results


1. Comparing the gauge variation to the process tolerance:

%P/T =

R &R

Tolerance

100% =

6 0.0666 100%= 28.5% 1.4

This is greater than 10% so the gauge will not be good enough for six sigma. As the process improves the gauge will become a problem. To improve this gauge we should start by addressing the reproducibility.

2. Comparing the gauge variation to the process variation:

%R & R =

R&R

100% =

Process(total) This is less than 50% so the gauge is not the limiting factor at the moment. We can use this gauge for process improvement.

0.0666 100% = 37% 0.18

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

34

Variable Gauge R&R - Minitab


Open Worksheet: GaugeR&R Stat>Quality Tools>Gage Study>Gage R& R (Crossed) Enter Part, Operators, Measurement Check ANOVA Method Select Options: Study Variation: 6 Process Tolerance: 1.4 Historical standard deviation: 0.18
Two-Way ANOVA Table With Interaction Source Part Operator Part * Operator Repeatability Total DF 9 2 18 30 59 SS 2.05871 0.04800 0.10367 0.03875 2.24913 MS 0.228745 0.024000 0.005759 0.001292 F 39.7178 4.1672 4.4588 P 0.000 0.033 0.000

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

17

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

35

Components of Variation
Components of Variation Gage R&R Source Total Gage R&R Repeatability Reproducibility Operator Operator*Part Part-To-Part Total Variation VarComp 0.0044375 0.0012917 0.0031458 0.0009120 0.0022338 0.0371644 0.0416019 %Contribution (of VarComp) 10.67 3.10 7.56 2.19 5.37 89.33 100.00 Study Var (6 * SD) 0.39969 0.21564 0.33653 0.18120 0.28358 1.15668 1.22379 %Study Var (%SV) 32.66 17.62 27.50 14.81 23.17 94.52 100.00 %Tolerance (SV/Toler) 28.55 15.40 24.04 12.94 20.26 82.62 87.41 %Process (SV/Proc) 37.01 19.97 31.16 16.78 26.26 107.10 113.31

Source Total Gage R&R Repeatability Reproducibility Operator Operator*Part Part-To-Part Total Variation

StdDev (SD) 0.066615 0.035940 0.056088 0.030200 0.047263 0.192781 0.203965

Number of Distinct Categories = 4

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

36

Components of Variation
Gage R&R (ANOVA) for Measurement
G age name: Date of study : Reported by : Tolerance: Misc:

Components of Variation
120
% Contribution % Study Var % Process % Tolerance

100

80 Percent

60

40

20

0 Gage R&R Repeat Reprod Part-to-Part

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

18

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

37

Part to Part Measurements


Gage R&R (ANOVA) for Measurement
Gage name: Date of study : Reported by : Tolerance: Misc:

Measurement by Part
1.1 1.0 0.9 0.8 0.7 0.6 0.5 0.4 1 2 3 4 5 Part 6 7 8 9 10

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

38

Operator by Part Interaction


Gage R&R (ANOVA) for Measurement
G age name: Date of study : Reported by : Tolerance: Misc:

Operator * Part Interaction


1.1 1.0 0.9 A verage 0.8 0.7 0.6 0.5 0.4 1 2 3 4 5 6 Part 7 8 9 10
Operator 1 2 3

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

19

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

39

Measurements by Operator
Gage R&R (ANOVA ) for Measurement
G age name: D ate of study : Reported by : Tolerance: M isc:

Measurement by Operator
1.1 1.0 0.9 0.8 0.7 0.6 0.5 0.4 1 2 Operator 3

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

40

Xbar and R Chart by Operator


Gage R&R (ANOVA) for Measurement
Gage name: Date of study : Reported by : Tolerance: M isc:

Xbar Chart by Operator


1 Sample Mean 1.0 0.8 0.6 0.4 _ L=0.8796 _ UC X=0.8075 LC L=0.7354 2 3

R Chart by Operator
1 Sample Range 0.12 0.08 0.04 0.00 _ R=0.0383 LC L=0 2 3 UC L=0.1252

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

20

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

41

Rounding Errors
Rounding is another component of measurement variation which needs to be minimised It can be shown that to avoid rounding error getting in the way of achieving six sigma quality, it is necessary to have a minimum of 14 discrete values between the upper and lower specification For one-side specifications, there need to be at least 7 discrete values between the process average and the specification limit

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

UG 37

42

Rounding Errors - Interpolating


If possible interpolate between graduation marks For example, thermometers are frequently marked to the nearest degree but can be read to the nearest 0.2 degrees, even if the last digit is not entirely accurate Interpolating frequently reduces and never increases the measurement variation
SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

21

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

43

Improving the Measurement System


Gauge incapable: Repeatability (Gauge)
Take multiple measurements and use average (short term fix) Mistake proofing (eg provision of tooling to hold part during measurement) May need maintenance

Reproducibility (Operators)
Use 1 operator (short term fix during improvement only) Have several operators measure the part and take the average (short term fix) Ensure consistency (training, SOPs, WIS, ) Mistake proofing (eg provision of tooling to hold part during measurement) Calibrations on the gauge dial may not be clear

Reproducibility Operator x Part Interaction


Identify cause of interaction and then as Operator

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

44

Destructive Gauge R&R


Destructive gauge testing means that it is impossible to carry out repeat tests! To complete an assessment of a destructive gauge it is therefore necessary to assume homogeneity within batches If there is much more difference in parts between batches than within batches, then a standard variable Gauge R & R may be sufficient

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

22

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

45

Workshop Variable Gauge R&R


Using the provided measuring device and products carry out a Gauge R&R
Use three operators and measure each part twice Ensure that the order of measuring is randomised

Analyse the data using Minitab What could you do, if anything to improve the Measurement System? Prepare a short report detailing your findings

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

Attribute Gauge R&R

SSG06101ENUK - MSA/Issue 1.3/July 2008

23

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

47

Attribute Gauge R&R


A Gauge R&R study can also be carried out on attribute data Using attribute data, we would have a problem with the measurement system if:
Operators disagree with each others evaluation of a piece The same operator gains different results from a repeat evaluation of the same piece

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

48

Attribute Measurement System


An attribute measurement system compares each part to a standard and either accepts or rejects the part The screen effectiveness is the ability of the attribute measurement system to properly discriminate good from bad Screen effectiveness of 100% is desirable

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

24

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

49

Conducting Attribute Gauge R&R


1. Select a minimum of 30 parts from the process. These parts should represent the full spectrum of process variation (good parts, defective parts, borderline parts). 2. An expert inspector performs an evaluation of each part, classifying it as Good or Not Good. 3. Independently and in a random order, each of 2 or 3 operators should assess the parts as Good or Not Good. 4. Calculate effectiveness scores.

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

50

Attribute Gauge R&R


Open Worksheet: Attribute Gage R&R

Minitab Data Layout:


Column containing parts being assessed Text column containing expert assessment (can use words or numbers but must be consistent) Text column containing results of measurements (can use words or numbers but must be consistent)

Text column containing operator performing measurements

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

25

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

51

Attribute Gauge R&R


Stat>Quality Tools>Attribute Agreement Analysis Enter Results in Attribute Column, Part in Samples, Appraiser in Appraisers and Expert in Known standard/attribute Click on Results button and select Percentages

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

52

Attribute Gauge R&R - Results


Appraiser A only agreed with the self 28 times out of 30 Appraiser A only agreed with the expert 28 times out of 30. Appraisers B and C only matched with the expert 29 times out of 30

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

26

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

53

Attribute Gauge R&R - Results


Appraisers B and C assessed one part as Not Good when the Expert assessed it good

Appraisers A,B and C agreed on 26 out of 30 parts inspected

Appraisers A,B and C all agreed with the standard on 26 out of 30 parts inspected

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

54

Attribute Gauge R&R - Results


Assessment Agreement
Date of study: Reported by : Name of product: Misc:

Within Appraisers
100
95.0% C I P ercent

Appraiser vs Standard
100
95.0% C I P ercent

95

95

Percent

90

Percent A B Appraiser C

90

85

85

80

80

B Appraiser

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

27

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

55

Attribute Gauge R&R - Results


The target effectiveness is always 100% Possible Corrective Actions include:
Operator Training Clarification of Standards Simplification of Standards Conversion to Variable Data

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

56

Workshop Attribute Gauge R&R


From your team select two expert inspectors The experts should select 20 sweets, roughly half good (pass) and half bad (fail). Some sweets should be borderline Carry out a Gauge R&R

Use two operators and measure each part twice (if more time available use three operators) Ensure that the order of measuring is randomised

Analyse the data What could you do, if anything, to improve the Measurement System? Prepare a short report detailing your findings

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

28

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

57

Summary
Measurement errors can account for a large proportion of the variation in our measures (ys) We must evaluate our measurement systems before assessing process stability or process capability Errors in measurement systems can come from a variety of sources Action should be taken to improve the capability of our measurement systems if they are found to be inadequate

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

Appendix - ANOVA

SSG06101ENUK - MSA/Issue 1.3/July 2008

29

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

59

ANOVA Table - Construction


Construction of an Analysis of Variance (ANOVA) table requires the following: 1. Identification of the Sources (Components) of Variation 2. Calculation of the Sum of Squares due to each Source of Variation 3. Assignment of the appropriate Degrees of Freedom 4. Calculation of the Mean Squares 5. Calculation of the F-Ratio

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

60

1. Components of Variation
Analysis of Variance (ANOVA) allows the decomposition of the variability in the Gauge R&R study. The components of variation in the Gauge R&R study are: 2Part 2Operator 2Operator x Part 2Repeatability 2Total = Variation due to the different parts = Variation due to different operators = Variation due to the interaction between operator and part = Variation due to gauge repeatability = 2Part + 2Operator + 2Operator x Part + 2Repeatability

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

30

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

61

2. Calculation of the Sum of Squares


The total sum of squares is calculated as follows:

SSTotal

( y) = (y y ) = y n
2 2

Strictly speaking the sum of squares column is the sum of squares around the mean, known as the corrected sum of squares. We always use the corrected sum of squares when estimating variation.

y =0.65 + 0.60 +1.00 +1.00 + .............+ 0.80 = 48.45 y = 0.65 + 0.60 +1.00 +1.00 + ........... + 0.80 = 41.3725 ( y) = 41.3725 (48.45) = 41.3725 39.1234= 2.2491 SS = y n 60
2 2 2 2 2 2 2 2 2 Total
SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

62

Calculation of the Sum of Squares


The sum of squares due to parts is calculated as follows:
SSPart = SSPart =

(P1 )2 + (P2 )2 + (P3 )2 + .........+ (P10 )2 ( y )


np n

(3.40) + (6.05) + (4.80)


6

+ .........+ (4.00)

(48.45)2
60

Where:

SSPart = 41.1821 39.1234= 2.0587

P1, P2, P3..P10 are the Sums for each part ie the Sum of the 6 measurements made on each part np is the number of individual measurements of each part

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

31

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

63

Calculation of the Sum of Squares


The sum of squares due to operators is calculated as follows:
SSOperator = SSOperator =

(O1 )2 + (O2 )2 + (O3 )2 ( y)


no n
2 2

(16.55) + (15.35) + (16.55)2 (48.45)2


20 60

SSOperator = 39.1714 39.1234 = 0.0480

Where: O1, O2, O3 are the Sums for each operator ie the sum of the 20 measurements made by each operator. no is the number of measurements made by each operator.

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

64

Calculation of the Sum of Squares


The sum of squares due to the interaction between operators and parts is calculated as follows:
SSOperatorPart = SSOperatorPart =

(O1P1 )2 + (O1P2 )2 + ..........O3P10 )2 ( y) (


nOP 2 n 60

SSOperator SSPart

(1.25)2 + (2.00)2 + ........(1.65)2 (48.45)2 0.0480 2.0587

SSOperatorPart = 41.3338 39.1234 0.0480 2.0587 = 0.1037


Where: O1P1, O1P2,.O3P10 are the Sums for each operator & part combination ie the sum of the 2 measurements made by each operator on each part nOxP is the number of measurements made by each operator on each part
SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

32

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

65

Calculation of the Sum of Squares


The sum of squares due to repeatability is obtained by subtraction:

SS Repeatability = SSTotal SS Part SSOperator SS Operator Part SS Repeatability = 2.2491 2.0587 0.0480 0.1037 = 0.0387

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

66

Calculation of the Sum of Squares


Source of Variation Between Parts Between Operators Operator x Part Repeatability Total Sum of Squares 2.0587 0.0480 0.1037 0.0387 2.2491

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

33

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

67

3. Degrees of Freedom
Degrees of Freedom is a statistical concept relating to the number of paired comparisons required to distinguish between items. For example, we need to find the tallest person out of 3 people. 2 comparisons would be required: Person 1 v Person 2 Tallest v Person 3 We would then know who the tallest person is.

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

68

Rules for Degrees of Freedom


The following rules apply to Degrees of Freedom: DF for a Factor (Main Effect) = (Number of Levels) 1 DF for interactions = Product of the DF of the Factors involved DF for Repeatability = (Product of Factor Levels) x (Repeats 1) Total DF = (Number of Individual Results) - 1

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

34

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

69

Degrees of Freedom
Source of Variation Between Parts Between Operators Operator x Part Repeatability Total Sum of Squares 2.0587 0.0480 0.1037 0.0387 2.2491 Degrees of Freedom 9 2 18 30 59

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

70

4. Calculation of the Mean Squares


The Mean Square is calculated as follows: Mean Square = (Sum of Squares) / (Degrees of Freedom) Source of Variation Sum of Squares DF Between Parts Between Operators Operator x Part Repeatability Total 2.0587 0.0480 0.1037 0.0387 2.2491 9 2 18 30 59
SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

Mean Square 0.2287 0.0240 0.0058 0.0013

SSG06101ENUK - MSA/Issue 1.3/July 2008

35

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

71

5. Calculation of the F-Ratio


Source of Variation Between Parts Between Operators Operator x Part Repeatability Total variation. F-Ratio for Parts = (MSParts) / (MSOperator x Part) F-Ratio for Operators = (MSOperators) / (MSOperator x Part) F-Ratio for Operator x Part = (MSOperators x Parts) / (MSRepeatability)
SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

Sum of Squares 2.0587 0.0480 0.1037 0.0387 2.2491

DF 9 2 18 30 59

Mean Square 0.2287 0.0240 0.0058 0.0013

F-Ratio 39.43 4.14 4.46

The F-Ratio is used to test the significance of each source of

72

Estimating Components of Variation


The Mean Square column is expected to contain the following components of variation. This expected mean square is only applicable to this current study, where we have 3 operators, 10 parts and 2 repeat measurements. For other studies, the number of the components will change. (Fortunately, Minitab can do this for us!)

Source Parts Operators Operator x Part Repeatability

Mean Square 0.2287 0.0240 0.0058 0.0013 6 2

Expected Mean Square


Part

+ 2 2

Operator Part

+ 2

Repeatability

20 2 2 2

Operator

+ 2 2

Operator Part

+ 2

Repeatability

Operator Part

+ 2

Repeatability

2 Repeatability

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

36

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

73

Estimating Components of Variation


Source Parts Operators Operator x Part Repeatability Mean Square 0.2287 0.0240 0.0058 0.0013 2

2 Repeatability
2 Operator Part

Expected Mean Square 6


2 Part 2 Operator

+ 2 2

Operator Part

+ 2

Repeatabil ity

20

+ 2 2 +

Operator Part 2 Repeatability

+ 2

Repeatability

2 Repeatability

= 0 . 0013 + 2
Repeatabil ity

2 2

2 Operator Part 2 Operator Part

= 0 . 0058

= 0 . 0058 0 . 0013 = 0 . 0045 = 0 . 00225

Operator Part

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

74

Estimating Components of Variation


Source Parts Operators Operator x Part Repeatability Mean Square 0.2287 0.0240 0.0058 0.0013 2
2

Expected Mean Square 6


2 Part 2 Operator

+ 2 2

Operator Part

+ 2

Repeatability

20
2

+ 2 2 +

Operator Part 2 Repeatability

+ 2

Repeatability

Operator Part

Repeatability
2 2 20 Operator + 2 Operator Part

2 Repeatabil ity

= 0 . 0240
ity

20
2

2 Operator

= 0 . 0240 - 2 2 Operator

Part

- 2 Repeatabil

Operator

( 0 . 0240 ) - 2 ( 0 . 00225 ) - 0 . 0013 20

= 0 . 00091

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

37

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

75

Estimating Components of Variation


Source Parts Operators Operator x Part Repeatability Mean Square 0.2287 0.0240 0.0058 0.0013
2 2 6 Part + 2 Operator

Expected Mean Square 6


2 Part 2 Operator

+ 2 2

Operator Part 2

+ 2

Repeatability

20 2
2 2

+ 2

Operator Part 2 Repeatability

+2

Repeatability

Operator Part

Repeatability

Part

+ 2

Repeatabil ity

= 0 . 2287

2 2 6 Part = 0 . 2287 2 Operator

Part

2 Repeatability = 0 . 03715

2 Part

0 . 2287 2 ( 0 . 00225 ) 0 . 0013 6

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

76

Estimating Components of Variation


2 Part = 0. 03715 2 Operator = 0. 00091 2 Operator Part = 0. 00225 2 Repeatabil ity = 0. 00130 2 2 2 2 2 Total = Part + Operator + Operator Part + Repeatabil ity 2 Total = 0. 03715 + 0. 00091 + 0. 00225 + 0. 00130 = 0. 04161

We have established estimates of each of the components of variation!

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

38

The British Standards Institution 2008

Lean Six Sigma Operational - Delegate Workbook

77

Variance Component Estimates


Part-to-Part Variation 0.03715 Overall Variation 0.04161 Measurement System Variation 0.00446 Repeatability 0.00130 Reproducibility 0.00316 Operator 0.00091

Operator by part Interaction 0.00225

Variances are additive!

SSG06101ENUK Delegate Slides/Issue 1.3/ July 2008

SSG06101ENUK - MSA/Issue 1.3/July 2008

39

The British Standards Institution 2008

Potrebbero piacerti anche