Regression in ANOVA
[Pages:30]Regression in ANOVA
James H. Steiger
Department of Psychology and Human Development Vanderbilt University
James H. Steiger (Vanderbilt University)
1 / 30
Regression in ANOVA
1 Introduction 2 Basic Linear Regression in R
3 Multiple Regression in R
4 Nested Models 5 ANOVA as Dummy Variable Regression
James H. Steiger (Vanderbilt University)
2 / 30
Introduction
Introduction
In this module, we begin the study of the classic analysis of variance (ANOVA) designs.
Since we shall be analyzing these models using R and the regression framework of the General Linear Model, we start by recalling some of the basics of regression modeling.
We work through linear regression and multiple regression, and include a brief tutorial on the statistical comparison of nested multiple regression models.
We then show how the classic ANOVA model can be (and is) analyzed as a multiple regression model.
James H. Steiger (Vanderbilt University)
3 / 30
Basic Linear Regression in R
Basic Linear Regression in R
Let's define and plot some artificial data on two variables.
> set.seed(12345) > x y plot(x, y)
2
1
0
y
-1
-2
-1
0
1
x
James H. Steiger (Vanderbilt University)
4 / 30
Basic Linear Regression in R
Basic Linear Regression in R
We want to predict y from x using least squares linear regression. We seek to fit a model of the form
yi = 0 + 1xi + ei = y^i + ei
while minimizing the sum of squared errors in the "up-down" plot direction. We fit such a model in R by creating a "fit object" and examining its contents. We see that the formula for y^i is a straight line with slope 1 and intercept 0.
James H. Steiger (Vanderbilt University)
5 / 30
Basic Linear Regression in R
Basic Linear Regression in R
We start by creating the model with a model specification formula. This formula corresponds to the model stated on the previous slide in a specific way:
1 Instead of an equal sign, a " "is used. 2 The coefficients themselves are not listed, only the predictor variables. 3 The error term is not listed 4 The intercept term generally does not need to be listed, but can be
listed with a "1". So the model on the previous page is translated as y ~ x.
James H. Steiger (Vanderbilt University)
6 / 30
Basic Linear Regression in R
Basic Linear Regression in R
We create the fit object as follows.
> fit.1 summary(fit.1)
Call: lm(formula = y ~ x)
Residuals:
Min
1Q Median
3Q Max
-1.8459 -0.6692 0.2133 0.5082 1.2330
Coefficients:
Estimate Std. Error t value Pr(>|t|)
(Intercept) 0.2549
0.1754 1.453 0.159709
x
0.8111
0.1894 4.282 0.000279 ***
---
Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
Residual standard error: 0.8771 on 23 degrees of freedom Multiple R-squared: 0.4435,Adjusted R-squared: 0.4193 F-statistic: 18.33 on 1 and 23 DF, p-value: 0.0002791
James H. Steiger (Vanderbilt University)
7 / 30
Basic Linear Regression in R
Basic Linear Regression in R
We see the printed coefficients for the intercept and for x.
There are statistical t tests for each coefficient. These are tests of the null hypothesis that the coefficient is zero.
There is also a test of the hypothesis that the squared multiple correlation (the square of the correlation between y^ and y ) is zero.
Standard errors are also printed, so you can compute confidence intervals. (How would you do that quickly "in your head?" (C.P.)
The slope is not significantly different from zero. Does that surprise you? (C.P.)
The squared correlation is .4435. What is the correlation in the population? (C.P.)
James H. Steiger (Vanderbilt University)
8 / 30
................
................
In order to avoid copyright disputes, this page is only a partial summary.
To fulfill the demand for quickly locating and searching documents.
It is intelligent file search solution for home and business.
Related download
- nonlinear regression functions
- introduction to time series regression and forecasting
- multiple regression results you should remember
- lecture 12 linear regression test and confidence intervals
- regression in anova
- comparing correlation coefficients slopes and intercepts
- presenting the results of a multiple regression analysis
- sta 3024 practice problems exam 2 note these are just
- chapter 8 the multiple regression model hypothesis tests
Related searches
- weighted regression in excel
- multinomial logistic regression in sas
- ordinal logistic regression in r
- probabilities ordinal logistic regression in r
- multiclass logistic regression in r
- ordinal logistic regression in spss
- multinomial logistic regression in spss
- plot logistic regression in r
- ordinal logistic regression in minitab
- regression in desmos
- how to run regression in excel
- what is regression in statistics