Topics for Policy Evaluation Class



Course Syllabus

ED 976

CAPSTONE IN EDUCATIONAL POLICY ANALYSIS AND EVALUATION

Instructor: Cassandra Guarino

Semester Spring 2010

Day Time: Monday 4:10-7:00pm

Room Number: C202 Wells Hall

Updated 1/11/10

This course outlines fundamental issues in the analysis and evaluation of education-related policies, examines prominent evaluations that have been conducted on a national, state, or local scale, and engages students in learning how to approach evaluation.  Its goal is to equip students with an in-depth understanding of what it takes to design both an effective educational policy and an effective evaluation. By understanding principles guiding evaluations, students will learn to assess the impact of existing policies and to develop research designs to assess the potential impact of proposed policies. Students will gain an awareness of the ways in which intended and unintended consequences can result from policies and the ways in which evaluations must be structured in order to provide objective evidence of effectiveness. Data requirements, sample design, sources of bias, and various analytic strategies will be discussed in detail. Knowledge of these issues will hone students’ ability to understand, evaluate, and shape educational interventions.

The class will be divided into two sequential parts. In Part 1—roughly the first half of the class meetings—the class will examine case studies, focusing on evaluations of particular policies—both large and small—such as the Tennessee Star experiment, California Class Size Reduction, and No Child Left Behind. Interspersed with these case studies will be instruction on particular methodological approaches to evaluation, such as experimental versus quasi-experimental design, the analysis of treatment effects, the use of surveys, interviews, and focus groups, and the role of mixed (quantitative and qualitative) methods. Students will be expected to read all materials and give individual in-class presentations that critique particular aspects of each case study.

In Part 2, students will conduct an evaluation of a specific policy, such as the Michigan Merit Curriculum. Research questions and a corresponding research design will be developed. Guest appearances from members of the Education Policy Center and/or the Michigan Department of Education will facilitate students’ understanding of the context. Both quantitative and qualitative methods will be used to investigate answers to the questions posed. Students will work in teams and participate in different aspects of the quantitative and qualitative portions of the evaluation. The final product concerning the evaluation will consist of a report on preliminary findings, a power point presentation that delivers these findings to the Education Policy Center, and a proposal for future research to complete the evaluation.

Instructor

Cassandra Guarino, an assistant professor in Measurement and Quantitative Methods and a former RAND economist, has led or participated in numerous policy evaluations. She studies teacher and school quality, teacher labor markets, school choice, and the connection between health and education. Her review of the empirical research on teacher recruitment and retention has been used nationally by policymakers and scholars as a guiding tool on the topic. Her work on teacher effectiveness has included an NCES study on early elementary mathematics teaching. Her work on school choice has included the evaluation of the charter school movement in California and charter schools in the nation of Qatar. Current work includes studies of value-added models of teacher and school performance, effective teaching practices, and teacher labor markets in North Carolina.

Requirements and Grading

Students are expected to prepare carefully for class, read all assigned papers, complete all assignments, and work collegially with classmates on the evaluation. One quarter of the grade will be based on presentations related to the case studies. One quarter will be based on in-class participation. One quarter will be based on team contributions to the evaluation. The final quarter of the grade will be based on an end-of-course examination.

Other Details

Students with disabilities: Reasonable accommodations for persons with documented disabilities will be made available. Please feel free to speak with us if there are issues of which we should be aware.

Academic Honesty and Integrity: Students are assumed to be honest, and course work is assumed to represent the student’s own work. Violations of the academic integrity policy such as cheating, plagiarism, selling course assignments or academic fraud are grounds for academic action and/or disciplinary sanction as described in the University’s student conduct code.

Incidents of Plagiarism: They will be taken very seriously and will be pursued. Students are strongly cautioned not to copy any text verbatim without appropriate quotations and source citations.

For University regulations on academic dishonesty and plagiarism, please refer to:



Class Meeting Schedule:

Jan 11 – Introduction

No Meeting Jan 18 – Martin Luther King, Jr. Day

Jan 25 – Tennessee Star I

Feb 1 – Tennessee Star II

Feb 8 – California Class Size Reduction

Feb 15 – NCLB I

Feb 22 – NCLB II

Mar 1 – Michigan Merit Curriculum evaluation begins

Mar 8 – Spring break

Mar 15

Mar 22

Mar 29

Apr 5

Apr 12 – Preliminary presentation and discussion

Apr 19 – Final presentations

Apr 26 – Final presentations

Final Exam (Take-home final due May 7th)

Selected Readings:

Tennessee STAR

Finn, J. & Achilles, C. (1990) Answers and questions about class size: A statewide experiment, AERJ, 27(3), 557-577.

Hanushek, E.  (1999) Some Findings from an Independent Investigation of the Tennessee STAR Experiment and From Other Investigations of Class Size Effects

Educational Evaluation and Policy Analysis, Vol. 21, No. 2, 143-163.

Konstantopoulos, S. (2008) Do small classes reduce the achievement gap between low and high achievers? Evidence from Project STAR. Elementary School Journal, 108(4), 275-291.

Krueger, A. (1999) Experimental estimates of education production functions. The Quarterly Journal of Economics, 115(2), 497-532.

Krueger, A. & Whitmore, D. (2001) The Effect of Attending a Small Class in the Early Grades on College-Test Taking and Middle School Test Results: Evidence from Project STAR The Economic Journal, Vol. 111, No. 468 (Jan., 2001), pp. 1-28

Mosteller, F. (1995) The Tennessee Study of Class Size in the Early School Grades. The Future of Children, 5(2), 113-127.

Nye, Hedges, & Konstantopoulos (2000) The effects of small class sizes on academic achievement: The results of the Tennessee class size experiment, AERJ, 37(1) 123-151.

California Class Size Reduction

Jepsen, C. & Rivkin, S. (2002) Class size reduction, teacher quality, and academic achievement in California public elementary schools. PPIC. San Francisco.

Stecher, B., Bohrnstedt, G., Kirst, M., McRobbie, J., Williams, T. (2001) Class-Size Reduction in California: A Story of Hope, Promise, and Unintended Consequences. The Phi Delta Kappan, Vol. 82, No. 9 (May, 2001), pp. 670-674.

Stecher, B., Bohrnstedt, G. (2002) Class Size Reduction in California: Summary of Findings from 1999-00 and 2000-01, Dept. of Education -CSR Research Consortium

NCLB and Accountability

Carnoy, M., & Loeb, S. (2002). Does external accountability affect student outcomes? A cross-state analysis. Educational Evaluation and Policy Analysis, 24(4), 305-331.

Available through:



%

Center on Education Policy (June, 2007). Answering the question that matters

most: Has student achievement increased since No Child Left Behind?

Executive Summary.

Available through:

Dee, T. & Jacob, B. (2009) The Impact of No Child Left Behind on Student Achievement

NBER Working Paper No. 15531.

Linn, R.L. (2000). Assessments and accountability. Educational Researcher, 29(2), 4-17.

Available through:



Zimmer, R., Hamilton, L., & Christina, R. (Forthcoming) After-school tutoring in the context of no Child Left Behind: Effectiveness of two programs in the Pittsburgh Public Schools. Economics of Education Review.

Program Evaluation

Imbens, G. & Wooldridge, J. (2009) Recent developments in the econometrics of program evaluation. Journal of Economic Literature, 47(1), 5-86.

................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download