Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Multiple Regression
The Multiple Regression
Model
Examine the linear relationship between
1 dependent (y) & 2 or more independent variables (xi)
Population model:
Y-intercept Population slopes Random Error
y = β0 + β1x1 + β 2 x 2 + + βk x k + ε
Estimated multiple regression model:
Estimated Estimated
(or predicted) intercept Estimated slope coefficients
value of y
ŷ = b0 + b1x1 + b 2 x 2 + + bk x k
Multiple Regression Model
Two variable model
y
ŷ = b0 + b1x1 + b 2 x 2
x1
e
abl
i
var
r
fo
ope x2
Sl
varia ble x 2
e fo r
S lo p
x1
Multiple Regression Model
Two variable model
y Sample
<yi
observation ŷ = b0 + b1x1 + b 2 x 2
yi
<
e = (y – y)
x2i
x2
<
x1i The best fit equation, y ,
is found by minimizing the
x1 sum of squared errors, Σ e2
Multiple Regression
Assumptions
<
e = (y – y)
600
500
400
300
Sales vs. Advertising
200 Sales
100 600
0 500
Price
0 2 4 6 8 10
400
300
200
100
0
Advertising
0 1 2 3 4
Multiple Regression Output
Regression Statistics
Multiple R 0.72213
R Square 0.52148
Adjusted R Square 0.44172
Standard Error 47.46341
Sales = 306.526 - 24.975(Pri ce) + 74.131(Adv ertising)
Observations 15
df SS MS F Significance F
ANOVA
Regression 2 29460.027 14730.013 6.53861 0.01201
Residual 12 27033.306 2252.776
Total 14 56493.333
models
What is the net effect of adding a new variable?
We lose a degree of freedom when a new x
variable is added
Did the new x variable add enough
n −1
R = 1 − (1 − R )
2 2
A size, k = number of independent variables)
n − k − 1
(where n = sample
Test Statistic:
bi − 0
t= (df = n – k – 1)
sbi
Are Individual Variables
Significant?
(continued)
Regression Statistics
Multiple R 0.72213 t-value for Price is t = -2.306, with
R Square 0.52148 p-value .0398
Adjusted R Square 0.44172
Standard Error 47.46341 t-value for Advertising is t = 2.855,
Observations 15 with p-value .0145
df SS MS F Significance F
ANOVA
Regression 2 29460.027 14730.013 6.53861 0.01201
Residual 12 27033.306 2252.776
Total 14 56493.333
SSE
sε = = MSE
n − k −1
Is this value large or small? Must compare to the
mean size of y for comparison
Standard Deviation of the
Regression Model
(continued)
Regression Statistics
Multiple R 0.72213
R Square 0.52148 The standard deviation of the
Adjusted R Square 0.44172 regression model is 47.46
Standard Error 47.46341
Observations 15
df SS MS F Significance F
ANOVA
Regression 2 29460.027 14730.013 6.53861 0.01201
Residual 12 27033.306 2252.776
Total 14 56493.333