Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Welcome to Measure
Process Discovery
Basics of MSA
Variables MSA
Attribute MSA
Process Capability
So far we have learned that the heart and soul of Six Sigma is
that it is a data-driven methodology.
– How do you know that the data you have used is accurate and
precise?
– How do know if a measurement is a repeatable and
reproducible?
Item to be Reference
Measured Measurement
Operator Measurement Equipment
Process
Procedure
Environment
The item to be measured can be a physical part, document or a scenario for customer service.
Operator can refer to a person or can be different instruments measuring the same products.
Reference is a standard that is used to calibrate the equipment.
Procedure is the method used to perform the test.
Equipment is the device used to measure the product.
Environment is the surroundings where the measures are performed.
The question…
Whenever you measure anything, the variation that you observe can
be segmented into the following components…
Observed Variation
Precision Accuracy
All measurement systems have error. If you don’t know how much of the
variation you observe is contributed by your measurement system, you
cannot make confident decisions.
If you were one speeding ticket away from losing your license, how
fast would you be willing to drive in a school zone?
Repeatability
For example:
– Manufacturing: One person measures the purity of multiple samples
of the same vial and gets different purity measures.
– Transactional: One person evaluates a contract multiple times (over
a period of time) and makes different determinations of errors.
Y Operator A
Operator B
For example:
– Manufacturing: Different people perform purity test on samples
from the same vial and get different results.
– Transactional: Different people evaluate the same contract and
make different determinations.
Accuracy
Warning, do not assume your
metrology reference is gospel.
Measurement
However, before you invest a lot of time analyzing the data, you
must ensure the data has integrity.
– The analysis should include a comparison with known
reference points.
– For the example of product returns, the transaction details
should add up to the same number that appears on financial
reports, such as the income statement.
+ =
Bias Bias
B i a s (y)
0.00
*
-e
*
*
Reference Value (x)
y = a + b.x
y: Bias, x: Ref. Value
a: Slope, b: Intercept
Attribute Variable
– Pass/Fail – Continuous scale
– Go/No Go – Discrete scale
– Document Preparation – Critical dimensions
– Surface imperfections – Pull strength
– Customer Service Response – Warp
Estimates for a Gage R&R study are obtained by calculating the variance
components for each term and for error. Repeatability, Operator and Operator*Part
components are summed to obtain a total Variability due to the measuring system.
We use variance components to assess the Variation contributed by each source of
measurement error relative to the total Variation.
SigmaXL® Report:
0.186980
Distinct Categories 1.41
0.031861517
5.8685 1.41
8 (Rounded Down )
OSSS LSS Green Belt v11.0 XL - Measure Phase 27 © OpenSourceSixSigma,LLC
Number of Distinct Categories
Recommended
5 or more Categories
% Tolerance
or % Contribution System is…
% Study Variance
Components of Variation
The SigmaXL® report breaks down the variation in the measurement system into specific
sources. The bar chart shown was created using Excel’s Clustered Column Bar Chart to
graphically display the Components of Variation. Each cluster of bars represents a source of
variation.
SigmaXL® provides an R Chart and Xbar Chart by Operator. The R chart consists of the following:
- The plotted points are the difference between the largest and smallest measurements on each part for each
operator. If the measurements are the same then the range = 0.
- The Center Line, is the grand average for the process.
- The Control Limits represent the amount of variation expected for the subgroup ranges. These limits are
calculated using the variation within subgroups.
If any of the points on the graph go above the upper Control Limit (UCL), then that operator is having problems
consistently measuring parts. The Upper Control Limit value takes into account the number of measurements by
an operator on a part and the variability between parts. If the operators are measuring consistently, then these
ranges should be small relative to the data and the points should stay in control.
SigmaXL® provides an R Chart and Xbar Chart by Operator. The Xbar Chart compares the part-to-part variation to
repeatability. The Xbar chart consists of the following:
- The plotted points are the average measurement on each part for each operator.
- The Center Line is the overall average for all part measurements by all operators.
- The Control Limits (UCL and LCL) are based on the variability between parts and the number of measurements in each
average.
Because the parts chosen for a Gage R&R study should represent the entire range of possible parts, this graph should
ideally show lack-of-control. Lack-of-control exists when many points are above the Upper Control Limit and/or below the
Lower Control Limit.
In this case there are several points out of control which indicates the measurement system is adequate.
The Multi-Vari Charts show each Part as a separate graph. Each Operator’s response readings are denoted as a vertical
line with the top tick corresponding to the Maximum value, bottom tick is the Minimum, and the middle tick is the Mean. The
horizontal line across each graph is the overall average for each part.
Ideally the connected means red line should be horizontal (i.e., small reproducibility) and the vertical lines should be short
(small repeatability).
Pattern Means…
The “By Part” Multi-Vari Chart allows us to analyze all of the measurements taken in the study arranged by
part. The measurements are represented by dots; the means by the middle bar. The red line connects the
average measurements for each part.
Ideally,
Multiple measurements for each individual part have little variation (the dots for one part will be close
together)
• Averages will vary enough that differences between parts are clear
The “By Operator” Multi-Vari Chart is created by modifying the X’s from parts to operator. This helps us
determine whether the variability in measurements are consistent across operators.
The by operator graph shows all the study measurements arranged by operator. Dots represent the
measurements; the middle bars represent the means. The red line connects the average measurements
for each operator.
You can also assess whether the overall Variability in part measurement is the same using this graph. Is
the spread in the measurements similar? Or is one operator more Variable than the others?
For this example, the measuring system contributes little to the overall Variation, as
confirmed by both the Gage R&R table and graphs.
The Variation due to the measurement system, as a percent of study (Total) Variation
is causing 16.80% of the Variation seen in the process.
By AIAG Standards this gage should be used. By all standards, the
data being produced by this gage is acceptable, and valid for analysis.
% Tolerance
or % Contribution System is…
% Study Variance
Repeatability Problems:
• Calibrate or replace gage.
• If only occurring with one operator, re-train.
Reproducibility Problems:
• Measurement machines
– Similar machines
• Ensure all have been calibrated and that the standard measurement
method is being utilized.
– Dissimilar machines
• One machine is superior.
• Operators
– Training and skill level of the operators must be assessed.
– Operators should be observed to ensure that standard procedures are
followed.
• Operator/machine by part interactions
– Understand why the operator/machine had problems measuring some parts
and not others.
• Re-measure the problem parts
• Problem could be a result of gage linearity
• Problem could be fixture problem
• Problem could be poor gage design
Crossed Design
• A Crossed Design is used only in non-destructive testing and assumes that all the
parts can be measured multiple times by either operators or multiple machines.
– Gives the ability to separate part-to-part Variation from measurement system
Variation.
– Assesses Repeatability and Reproducibility.
– Assesses the interaction between the operator and the part.
Nested Design
• A Nested Design is used for destructive testing (we will learn about this in MBB
training) and also situations where it is not possible to have all operators or machines
measure all the parts multiple times.
– Destructive testing assumes that all the parts within a single batch are identical
enough to claim they are the same.
– Nested designs are used to test measurement systems where it is not possible
(or desirable) to send operators with parts to different locations.
– Do not include all possible combinations of factors.
– Uses slightly different mathematical model than the Crossed Design.
Step 1: Call a team meeting and introduce the concepts of the Gage R&R
Step 2: Select parts for the study across the range of interest
– If the intent is to evaluate the measurement system throughout the process
range, select parts throughout the range
– If only a small improvement is being made to the process, the range of interest is
now the improvement range
Step 3: Identify the inspectors or equipment you plan to use for the analysis
– In the case of inspectors, explain the purpose of the analysis and that the
inspection system is being evaluated not the people
Step 4: Calibrate the gage or gages for the study
– Remember Linearity, Stability and Bias
Step 5: Have the first inspector measure all the samples once in random order
Step 6: Have the second inspector measure all the samples in random order
– Continue this process until all the operators have measured all the parts one time
– This completes the first replicate
Step 7: Repeat steps 5 and 6 for the required number of replicates
– Ensure there is always a delay between the first and second inspection
Step 8: Enter the data into SigmaXL® and analyze your results
Step 9: Draw conclusions and make changes if necessary
Trial 1
Operator 1
Trial 2
P
a
Trial 1
r 1 2 3 4 5 6 7 8 9 10 Operator 2
t Trial 2
s
Trial 1
Operator 3
Trial 2
OSSS LSS Green Belt v11.0 XL - Measure Phase 42 © OpenSourceSixSigma,LLC
Data Collection Sheet
Variables:
– Part
– Operator
– Response
Looking at the “Components of Variation” chart, the Part to Part Variation needs to be
larger than Gage Variation.
If in the “Components of Variation” chart the “Gage R&R” bars are larger than the “Part-to-
Part” bars, then all your measurement Variation is in the measuring tool i.e.… “maybe the
gage needs to be replaced”.
Part to Part
Variation needs to
be larger than
Gage Variation
Suppose the Standard Deviation for one part measured by one person
many times is 9.5.
An Attribute MSA is similar in many ways to the continuous MSA, including the
purposes. Do you have any visual inspections in your processes? In your experience
how effective have they been?
Take 60 Seconds and count the number of times “F” appears in this
paragraph?
2 M&M Fail
• Pick 50 M&Ms out of a package.
3 M&M Pass
• Enter results into SigmaXL®'s Attribute MSA Template and
draw conclusions.