Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Gudono
Keterangan: Bahan kuliah ini diambil dari Wikipedia. Bagi mhs yang mengendaki materi yg lebih lengkap saya sarankan untuk membaca buku-buku statistik terkait.
Student's t-test
From Wikipedia, the free encyclopedia
A t-test is any statistical hypothesis test in which the test statistic follows a Student's t distribution if the null hypothesis is true. It is most commonly applied when the test statistic would follow a normal distribution if the value of a scaling term in the test statistic were known. When the scaling term is unknown and is replaced by an estimate based on the data, the test statistic (under certain conditions) follows a Student's t distribution.
History
The t-statistic was introduced in 1908 by William Sealy Gosset, a chemist working for the Guinness brewery in Dublin, Ireland ("Student" was his pen name).[1][2][3] Gosset had been hired due to Claude Guinness's innovative policy of recruiting the best graduates from Oxford and Cambridge to apply biochemistry and statistics to Guinness' industrial processes.[2] Gosset devised the t-test as a way to cheaply monitor the quality of stout. He published the test in Biometrika in 1908, but was forced to use a pen name by his employer, who regarded the fact that they were using statistics as a trade secret. In fact, Gosset's identity was unknown to fellow statisticians.[4]
Uses
Among the most frequently used t-tests are:
A one-sample location test of whether the mean of a normally distributed population has a value specified in a null hypothesis. A two sample location test of the null hypothesis that the means of two normally distributed populations are equal. All such tests are usually called Student's t-tests, though strictly speaking that name should only be used if the variances of the two
1
populations are also assumed to be equal; the form of the test used when this assumption is dropped is sometimes called Welch's t-test. These tests are often referred to as "unpaired" or "independent samples" t-tests, as they are typically applied when the statistical units underlying the two samples being compared are non-overlapping.[5]
A test of the null hypothesis that the difference between two responses measured on the same statistical unit has a mean value of zero. For example, suppose we measure the size of a cancer patient's tumor before and after a treatment. If the treatment is effective, we expect the tumor size for many of the patients to be smaller following the treatment. This is often referred to as the "paired" or "repeated measures" t-test:[5][6] see paired difference test. A test of whether the slope of a regression line differs significantly from 0.
Assumptions
Most t-test statistics have the form T = Z/s, where Z and s are functions of the data. Typically, Z is designed to be sensitive to the alternative hypothesis (i.e. its magnitude tends to be larger when the alternative hypothesis is true), whereas s is a scaling parameter that allows the distribution of T to be determined. As an example, in the one-sample t-test Z is , where is the sample mean of the data, n is the sample size, and is the population standard deviation of the data; s in the one-sample ttest is , where is the sample standard deviation.
Z follows a standard normal distribution under the null hypothesis 2 ps2 follows a distribution with p degrees of freedom under the null hypothesis, where p is a positive constant Z and s are independent.
In a specific type of t-test, these conditions are consequences of the population being studied, and of the way in which the data are sampled. For example, in the t-test comparing the means of two independent samples, the following assumptions should be met:
Each of the two populations being compared should follow a normal distribution (which can be tested using a normality test, such as the Shapiro-Wilk and Kolmogorov-Smirnov tests, or which can be assessed graphically using a normal quantile plot). If using Student's original definition of the t-test, the two populations being compared should have the same variance (testable using Levene's test, Bartlett's test, or the BrownForsythe test; or assessable graphically using a normal quantile plot). If the sample sizes in the two groups being compared are roughly equal, Student's original t-test is highly robust to the presence of unequal variances [7]. Welch's t-test is insensitive to equality of the variances regardless of whether the sample sizes are similar.
2
The data used to carry out the test should be sampled independently from the two populations being compared. This is in general not testable from the data, but if the data are known to be dependently sampled (i.e. if they were sampled in clusters), then the classical t-tests discussed here may give misleading results.
Calculations
Explicit expressions that can be used to carry out various t-tests are given below. In each case, the formula for a test statistic that either exactly follows or closely approximates a t-distribution under the null hypothesis is given. Also, the appropriate degrees of freedom is given in each case. Each of these statistics can be used to carry out either a one-tailed test or a two-tailed test.
Once a t value is determined, a p-value can be found using a table of values from Student's tdistribution. If the calculated p-value is below the threshold chosen for statistical significance (usually the 0.10, the 0.05, or 0.01 level), then the null hypothesis is rejected in favor of the alternative hypothesis.
where s is the sample standard deviation of the sample and n is the sample size. The degrees of freedom used in this test is n 1.
where xi, i = 1, ..., n are known, and are unknown, and i are independent normally distributed random errors with expected value 0 and unknown variance 2, and Yi, i = 1, ..., n are observed. It is desired to test the null hypothesis that the slope is equal to some specified value 0 (often taken to be 0, in which case the hypothesis is that x and y are unrelated).
Let
Then
has a t-distribution with n 2 degrees of freedom if the null hypothesis is true. The standard error of the angular coefficient:
the two sample sizes (that is, the number, n, of participants of each group) are equal; it can be assumed that the two distributions have the same variance.
Violations of these assumptions are discussed below. The t statistic to test whether the means are different can be calculated as follows:
where
Here is the grand standard deviation (or pooled standard deviation), 1 = group one, 2 = group two. The denominator of t is the standard error of the difference between two means.
5
For significance testing, the degrees of freedom for this test is 2n 2 where n is the number of participants in each group. Unequal sample sizes, equal variance This test is used only when it can be assumed that the two distributions have the same variance. (When this assumption is violated, see below.) The t statistic to test whether the means are different can be calculated as follows:
where
Note that the formulae above are generalizations for the case where both samples have equal sizes (substitute n1 and n2 for n and you'll see). is an estimator of the common standard deviation of the two samples: it is defined in this way so that its square is an unbiased estimator of the common variance whether or not the population means are the same. In these formulae, n = number of participants, 1 = group one, 2 = group two. n 1 is the number of degrees of freedom for either group, and the total sample size minus two (that is, n1 + n2 2) is the total number of degrees of freedom, which is used in significance testing. Unequal sample sizes, unequal variance This test is used only when the two population variances are assumed to be different (the two sample sizes may or may not be equal) and hence must be estimated separately. See also Welch's t-test. The t statistic to test whether the population means are different can be calculated as follows:
where
Where s2 is the unbiased estimator of the variance of the two samples, n = number of participants, 1 = group one, 2 = group two. Note that in this case, is not a pooled variance. For use in significance testing, the distribution of the test statistic is approximated as being an ordinary Student's t distribution with the degrees of freedom calculated using
This is called the Welch-Satterthwaite equation. Note that the true distribution of the test statistic actually depends (slightly) on the two unknown variances: see BehrensFisher problem.
For this equation, the differences between all pairs must be calculated. The pairs are either one person's pre-test and post-test scores or between pairs of persons matched into meaningful groups (for instance drawn from the same family or age group: see table). The average (XD) and standard deviation (sD) of those differences are used in the equation. The constant 0 is non-zero if you want to test whether the average of the difference is significantly different from 0. The degree of freedom used is N 1. Example of matched pairs Pair Name Age Test 1 1 2 2 Jon Jane 35 36 250 340 460 200 Example of repeated measures Number 1 2 3 4 Name Mike Test 1 Test 2 35% 67% 46% 86% 91%
Jimmy 22 Jessy 21
Mitchell 78%
Worked examples
Suppose two random samples of screws have weights
7
30.02, 29.99, 30.11, 29.97, 30.01, 29.99 and 29.89, 29.93, 29.72, 29.98, 30.02, 29.98. We will carry out tests of the null hypothesis that the population means underlying the two samples are equal. The difference between the two sample averages, which appears in the numerator for all the twosample testing approaches discussed above, is
The sample standard deviations for the two samples are approximately 0.05 and 0.11, respectively. For such small samples, a test of equality between the two population variances would not be very powerful. Since the sample sizes are equal, the two forms of the two sample ttest will perform similarly in this example.
Unequal variances
If we follow the approach for unequal variances, discussed above, we get
and
The test statistic is approximately 1.959. The two-tailed test p-value is approximately 0.091 and the one-tailed p-value is approximately 0.045.
Equal variances
If we follow the approach for equal variance, discussed above, we get
and
Since the sample sizes are equal (both are 6), the test statistic is again approximately equal to 1.959. Since the degrees of freedom is different from what it is in the unequal variances test, the
8
p-values will differ slightly from what was found above. Here, the two-tailed p-value is approximately 0.078, and the one-tailed p-value is approximately 0.039. Thus if there is good reason to believe that the population variances are equal, the results become somewhat more suggestive of a difference in the mean weights for the two populations of screws.
Multivariate testing
A generalization of Student's t statistic, called Hotelling's T-square statistic, allows for the testing of hypotheses on multiple (often correlated) measures within the same sample. For instance, a researcher might submit a number of subjects to a personality test consisting of multiple personality scales (e.g. the Big Five). Because measures of this type are usually highly correlated, it is not advisable to conduct separate univariate t-tests to test hypotheses, as these would neglect the covariance among measures and inflate the chance of falsely rejecting at least one hypothesis (Type I error). In this case a single multivariate test is preferable for hypothesis testing. Hotelling's T 2 statistic follows a T 2 distribution. However, in practice the distribution is rarely used, and instead converted to an F distribution.
One-sample T 2 test
For a one-sample multivariate test, the hypothesis is that the mean vector ( ) is equal to a given vector ( ). The test statistic is defined as:
is a
sample
Two-sample T 2 test
For a two-sample multivariate test, the hypothesis is that the mean vectors ( samples are equal. The test statistic is defined as , ) of two
Implementations
Most spreadsheet programs and statistics packages, such as Microsoft Excel, SPSS, DAP, gretl, R and PSPP include implementations of Student's t-test.
See also
Notes
1. ^ Richard Mankiewicz, The Story of Mathematics (Princeton University Press), p.158. 2. ^ a b O'Connor, John J.; Robertson, Edmund F., "Student's t-test", MacTutor History of Mathematics archive, http://www-history.mcs.st-andrews.ac.uk/Biographies/Gosset.html. 3. ^ Fisher Box, Joan (1987). "Guinness, Gosset, Fisher, and Small Samples". Statistical Science 2 (1): 4552. http://www.jstor.org/stable/2245613. 4. ^ Raju TN (2005). "William Sealy Gosset and William A. Silverman: two "students" of science". Pediatrics 116 (3): 7325. doi:10.1542/peds.2005-1134. PMID 16140715. 5. ^ a b Fadem, Barbara (2008). High-Yield Behavioral Science (High-Yield Series). Hagerstwon, MD: Lippincott Williams & Wilkins. ISBN 0-7817-8258-9. 6. ^ Zimmerman, Donald W. (1997). "A Note on Interpretation of the Paired-Samples t Test". Journal of Educational and Behavioral Statistics 22 (3): 349360. http://www.jstor.org/stable/1165289.
10
7. ^ Markowski, Carol A; Markowski, Edward P. (1990). "Conditions for the Effectiveness of a Preliminary Test of Variance". The American Statistician 44 (4): 322326. http://www.jstor.org/stable/2684360. 8. ^ David, HA; Gunnink, Jason L (1997). "The Paired t Test Under Artificial Pairing". The American Statistician 51 (1): 912. http://www.jstor.org/stable/2684684.
References
O'Mahony, Michael (1986). Sensory Evaluation of Food: Statistical Methods and Procedures. CRC Press. pp. 487. ISBN 0-824-77337-3. Press, William H.; Saul A. Teukolsky, William T. Vetterling, Brian P. Flannery (1992). Numerical Recipes in C: The Art of Scientific Computing. Cambridge University Press. pp. p. 616. ISBN 0-521-43108-5. http://www.nr.com/.
11