SST SSE SSR - Dalhousie University
The Analysis of Variance for Simple Linear Regression
? the total variation in an observed response about its mean can be written as a sum of two parts - its deviation from the fitted value plus the deviation of the fitted value from the mean response
yi - y? = (yi - y^i) + (y^i - y?)
? squaring both sides gives the total sum of squares on the left, and two terms on the right (the third vanishes)
? this is the analysis of variance decomposition for simple linear regression
SST = SSE + SSR
? as always, the total is
n
SST = (yi - y?)2 = SSY Y
i=1
1
? the residual sum of squares is
n
SSE = (yi - y^i)2
i=1
n
= (yi - y? - ^1(xi - x?))2
i=1
= SSY Y - 2^1SSXY + ^12SSXX
= SSY Y - ^12SSXX
= SSY Y - ^1SSXY
=
SSY Y
-
SSX2 Y SSXX
? the regression sum of squares is
n
SSR = (y^i - y?)2
i=1 n
= (^1(xi - x?))2
i=1
2
n
=
^12(xi - x?)2
i=1
=
^12SSXX
= ^1SSXY
=
SSX2 Y SSXX
? in completing the square above, the third term is
n
2 (yi - y^i)(y^i - y?)
i=1 n
= 2 (yi - y^i)^1(xi - x?)
i=1 n
= 2^1 e^i(xi - x?) = 2^1SSe^X
i=1
=0
using the result that the residuals are uncorrelated with the predictors
? the degrees of freedom are n - 1, n - 2 and 1 corresponding to SST, SSE and SSR
3
? the results can be summarized in tabular form
Source
DF SS
MS
Regression
1 SSR
MSR = SSR/1
Residual n - 2 SSE MSE = SSE/(n-2)
Total
n - 1 SST
Example: For the Ozone data
? SST = SSY Y = 1014.75 ? S79S9R.13=81SSSSxx2xy = (-2.7225)2/.009275 =
? SSE = SST - SSR = 1014.75 - 799.1381 = 215.62
? degrees of freedom: total = 4-1=3, regression = 1, error = 2
4
? goodness of fit of the regression line is measured by the coefficient of determination
R2
=
SSR SST
? this is the proportion of variation in y explained by the regression on x
? R2 is always between 0, indicating nothing is explained, and 1, indicating all points must lie on a straight line
? for simple linear regression R2 is just the square of the (Pearson) correlation coefficient
R2
=
SSR SST
=
SSX2 Y /SSXX SSY Y
=
SSX2 Y SSXX SSY Y
= r2
5
................
................
In order to avoid copyright disputes, this page is only a partial summary.
To fulfill the demand for quickly locating and searching documents.
It is intelligent file search solution for home and business.
Related download
- ap 2006 statistics samples college board
- calibration and linear regression analysis a self guided
- residual standard error and r 2 evan l ray
- 12 regression diagnostics in spss
- section 4 3 magnitude of a typical regression residual
- sst sse ssr dalhousie university
- 3 linear least squares regression
- section 5e residuals standard deviation of the residual
- glm residuals and diagnostics myweb