Response to Intervention Progress Monitoring Resources for ...

Response to Intervention Progress Monitoring Resources for Grades K?12

Date March 13, 2009

Number 00080

Request

A state department of education (SDE) served by the Southeast Comprehensive Center (SECC) has requested information on response to intervention (RtI) progress monitoring resources for reading, writing, and mathematics for grades K?12.

Summary

In response to this request, SECC staff queried a number of education research and dissemination organizations and assessment research experts to obtain information on RtI progress monitoring resources. They also conducted Web and hand searches to obtain information. Details are provided below including search results, references, and a resource list that may offer additional information.

Introduction

There has been increased attention on the use of progress monitoring tools due to federal legislation designed to improve students' academic performance. The No Child Left Behind Act of 2001 (NCLB) calls for school accountability, and the Individuals with Disabilities Education Act of 2004 (IDEA) provides schools with an option to use students' response to research-based instruction in making special education eligibility decisions. This legislation and related policies highlight the need for educators and administrators to implement the use of progress monitoring assessment tools to track students' academic and behavioral progress toward predetermined goals or objectives (McMaster & Espin, 2007). For example, in response to Reading First, an NCLB provision, Florida established the Progress Monitoring and Reporting Network (PMRN), a progress monitoring data delivery system (Roehrig, Duggar, Moats, Glover, & Mincey, 2008). Many local education agencies (LEAs) across the country are already implementing or in the process of establishing progress monitoring data systems and professional development for teachers.

Progress monitoring can be described as an evidence-based practice that is utilized to assess students' academic performance and evaluate the effectiveness of instruction/intervention (Fuchs & Fuchs, 2008). Progress monitoring is composed of administering brief assessments to measure student progress and takes place on a regular basis (weekly or monthly).

The purpose of progress monitoring is to determine whether or not students are responding successfully to instruction/intervention, which makes this practice an essential feature of response to intervention or RtI (Stecker, Fuchs, & Fuchs, 2008). The National Center on Response to Intervention (2008) identified various functions of progress monitoring within an RtI model. In Tier 1, progress monitoring serves as a screening mechanism to identify students

1

3501 N. Causeway Blvd, Suite 700 Metairie, LA 70002 | 800-644-8671 | secc. |

Rapid Response REQUEST

who may be at risk of academic/behavioral failure. At Tier 2 and beyond, the function of progress monitoring is to determine whether or not an intervention is successful in helping students learn at an appropriate rate.

Monitoring progress to evaluate response to instruction is a very important process that is critical to students' academic growth. Fuchs and Fuchs (2008) noted that students benefit greatly when progress is monitored correctly. For example, accelerated learning occurs, better instructional decisions are made, students' progress is documented for the purposes of accountability, efficient communication of student progress takes place, teachers hold higher expectations for student performance, and fewer referrals are made for special education testing.

The objective of this rapid response resource is to provide information about selected progress monitoring tools in reading, writing, and mathematics for grades K?12. This report is structured into five sections (1) Introduction, (2) Limitations of rapid response report, (3) Selection of progress monitoring resources, (4) Description and evaluation of selected resources, (5) References, and (6) Additional resources.

Limitations of Rapid Response Report

The goal of this report is to provide state departments of education (SDEs) and other stakeholders with researchbased information regarding progress-monitoring measures that would enable decision makers to weigh options and make informed recommendations to LEAs. Decision makers should use caution when using this report because the selected tools featured do not include all progress monitoring tools in reading, written expression, and mathematics that are commercially available for grades PreK?12. The SECC focused on tools that have been judged to be adequate based on the work of other researchers, organizations, and assessment experts. Hence, the SECC did not judge the technical soundness (e.g. reliability, validity) of identified measures. Another important limitation is that very few progress monitoring tools for high school students were found.

Current research only supports the use of student progress monitoring in the elementary grades. This is not to say that progress monitoring cannot be done at the secondary level; however, research to support its use at the secondary level is not yet available (National Center on Student Progress Monitoring, e-mail communication, May 5, 2006).

Selection of Progress Monitoring Resources

This section clearly states the methods and procedures that the SECC used to find information on progress monitoring assessment tools that are included in this report as well as an analysis of why selected tools are included. In response to this request, the SECC's search included various Web sources for information on progress monitoring assessments for K?12 students. The SECC also searched the following Web sites, including comprehensive and content centers (e.g., Accountability and Assessment Comprehensive Center, Center on Instruction); federally-funded centers (e.g., National Center on Student Progress Monitoring and National Center on Response to Intervention housed at the American Institute for Research (AIR), Research Institute on Progress Monitoring); regional educational laboratories or RELs (e.g., Northwest REL); Institutions of Higher Learning (e.g., Florida Center for Reading Research); and commercial assessment vendors (e.g., DIBELS, AIMSweb, iSTEEP, School House Technologies, Jamestown Reading Navigator, Vantage Learning, and Intervention Central).

In addition, the SECC conducted hand searches of several hard copy articles, reference lists, and reports; contacted assessment research experts via e-mail; searched an electronic database (ERIC), SEDL's Information Resource Center, and universities conducting research on progress monitoring (e.g., University of Oregon, Vanderbilt University, University of Minnesota, Iowa State University). Also, the SECC used information from articles published in both peer reviewed and non-peer reviewed journals to prepare this response.

The SECC chose to include progress monitoring measures that were vetted, approved, and recommended by federally funded centers such as the National Center on Progress Monitoring. This ensures that measures that have

2

SOUTHEAST COMPREHENSIVE CENTER at SEDL | 800-644-8671 | secc.

Rapid Response REQUEST

been proven to be effective in assessing student performance are included in this report. Since the requester of this report expressed interest in low-cost instruments as well as tools that are not time consuming, the cost and administration time of assessment tools were factors in determining which tools to include. All progress-monitoring instruments that were found for middle and high school were included regardless of cost because of the paucity of progress monitoring tools at the secondary level. To make information about progress monitoring tools readily accessible to SDE staff, the SECC also chose to include progress monitoring Web sites of federally funded centers as well as commercial vendors.

Description and Evaluation of Selected Resources

This section contains a synopsis of the progress monitoring tools that were found to meet the SECC's selection process. Overall, the SECC found more progress monitoring measures in elementary reading than mathematics or written expression. Partly, because more research investigations have occurred in elementary reading, and there are agreed upon general outcome measures in foundational reading skills at the elementary grades. Also, there are a limited number of progress monitoring tools for secondary students (middle and high school) in reading, writing, and mathematics. The results for each content area are displayed in table format in the appendix of this response report. Information provided in the tables includes the name of the assessment tool or resource, skills tested and the testing format, length of administration, a brief description, age and/or grade-level groups, the source along with the URL when available, and cost.

For reading, 13 progress monitoring instruments in various skill areas were selected, with a limited number of assessments for secondary students (middle and high school). Additionally, the SECC included 13 written expression measures, with five measures addressing secondary students. All five progress-monitoring measures in mathematics that were included addressed secondary students, as well.

Progress Monitoring Tools in Reading

As part of NCLB, schools that receive Reading First grants are required to use approved reading programs and assessment plans, which make it imperative that teachers use progress monitoring data to inform literacy instruction (Roehrig, Duggar, Moats, Glover, & Mincey, 2008). "The purpose of progress monitoring in reading is to determine whether or not students are responding successfully to reading instruction and/or intervention" (Dimino & Santoro, 2008, p.1).

According to Reading Next (Biancorosa & Snow, 2006), formative and summative assessments along with professional development are the three critical elements needed to improve adolescent literacy. "No literacy program targeted at older readers is likely to cause significant improvements without these elements because of their importance to ensuring instructional effectiveness and measuring effects" (p. 5). Formative assessment takes place during the course of instruction to shape and refine ongoing teaching and learning" (Hermitage, 2008, p.4), while summative assessment takes place at the end of units of study.

Listed in Table 1, Appendix, Tables 1?3, RtI Progress Monitoring Tools and Resources, are brief summaries of individually or group-administered progress monitoring assessments in grades K?12 that measure general reading readiness and basic reading skills in phonemic awareness, decoding, comprehension (listening and word), vocabulary, word identification, structural analysis, phonics, graphophonemic knowledge, and fluency (oral reading, letter naming, letter sound, phoneme segmentation, and nonsense word).

The SECC also obtained information on the selection process for progress monitoring instruments from the Institute for the Development of Educational Achievement. In the institute's report, Analysis of Reading Assessment Instruments for K?3 (2002), the executive summary of the document provides

? A brief description of the process used to identify, select, and analyze K?3 reading assessment instruments; and ? A brief summary of the assessment committee's results and recommendations.

3

SOUTHEAST COMPREHENSIVE CENTER at SEDL | 800-644-8671 | secc.

Rapid Response REQUEST

The assessment committee identified the following 24 measures out of the 29 reviewed to have "sufficient evidence" for use as screening, diagnostic, progress monitoring, and/or outcome instruments to assess one or more essential reading components (e.g., phonemic awareness, phonics, fluency, vocabulary, and reading comprehension) at one or more grade levels K?3:

? Clinical Evaluation of Language Fundamentals--3rd Ed (CELF?3) ? Comprehensive Test of Phonological Processing (CTOPP) ? Curriculum-Based Measurement (CBM) Oral Reading Fluency ? Degrees of Reading Power (DRP) ? Dynamic Indicators of Basic Early Literacy Skills (DIBELS)--5th Ed ? Early Reading Diagnostic Assessment (ERDA) ? Gray Oral Reading Test--IV (GORT--IV) ? Iowa Test of Basic Skills (ITBS) ? Letter Sound Fluency ? Lindamood Auditory Conceptualization Test, LAC Test ? Peabody Picture Vocabulary Test--(PPVT--3) ? Phonological Awareness Test ? Slosson Oral Reading Test--Revised (SORT--R) ? Stanford Achievement Test--9th Ed (SAT--9) ? Terra Nova--CAT (2nd Ed Terra Nova; 6th Ed CAT) ? Test of Language Development--Primary: 3 (TOLD--P: 3) ? Test of Phonological Awareness (TOPA) ? Test of Word Knowledge (TOWK) ? Test of Word Reading Efficiency (TOWRE) ? Texas Primary Reading Inventory (TPRI) ? Wechsler Individual Achievement Test--II (WIAT--II) ? Woodcock-Johnson III Test of Achievement ? Yopp-Singer Test of Phoneme Segmentation

According to the report, the following 5 measures were found not to have "sufficient evidence" for use as screening, diagnosis, progress monitoring, and/or outcome instruments

? Auditory Analysis Test ? An Observation Survey of Early Literacy Achievement ? Qualitative Reading Inventory (QRI) ? Roswell-Chall Auditory Blending ? Woodcock-Johnson III Tests of Cognitive Abilities

Progress Monitoring Tools in Written Expression

"Along with reading comprehension, writing skills is a predictor of academic success" (Graham & Perrin, 2007, p.3). In a literature review of written expression, McMaster and Espin (2007) stated that sound measures of written expression are needed to ensure that students are progressing towards writing standards. These researchers explained that CBM, a procedure in which multiple probes are administered repeatedly to provide student progress data over time, has proven to be very effective in improving student outcomes. The purpose of progress monitoring in writing is to assess students' progress towards meeting states' content standards. The SECC's search of progress monitoring tools yielded several CBMs, and listed in Table 2 Appendix, Tables 1?3, are Web resources containing progress monitoring assessments in written expression (e.g., writing fluency) for grades K?12.

Progress Monitoring Tools in Mathematics

There is a growing demand for mathematics progress monitoring tools because of increased emphasis on improving student outcomes. Unfortunately, limited or nonexistent research in several areas of mathematics progress monitoring tools, especially in high school is a problem (Foegen, Jiban, & Deno, 2007). Due to gaps in high school mathematics progress monitoring tools, Foegen and her colleagues began a 3-year project (Project AAIMS) to

4

SOUTHEAST COMPREHENSIVE CENTER at SEDL | 800-644-8671 | secc.

Rapid Response REQUEST

develop and validate tools for Pre-Algebra and Algebra 1 courses (Foegen, 2008). Moreover, a research analyst at the National Center on Response to Intervention at the AIR explained that

there are not a lot of resources available for secondary progress monitoring in general, and even less in the area of math. . .Math Computation CBM has been used more frequently with grades 1?6. These are available from a number of companies including AIMSweb, Intervention Central, and Wireless generation. AIMsweb is the only company that has Math Computation CBM measures available for grades 7?8 and no companies market CBM specifically for grades 9?12. The problem is that there are no agreed upon general outcome measures for high school math and most progress monitoring measures for math are based on basic computation, which technically should be mastered by the 7?8 grade (e-mail communication, November 13, 2008).

Listed in Table 3, Appendix, Tables 1?3, are brief summaries of individually or group administered progressmonitoring measures in early numeracy (oral counting, number identification, quantity discrimination, and missing number), and basic skills (computation, problem solving, concepts, and application).

References

Deno, S., Reschly, A., Lembke, E., Magnusson, D., Callender, S., Windram, H., & Stachel, N. (2009). Developing a schoolwide progress-monitoring system. Psychology in the Schools, 46, 44?55.

Dimino, J. A., & Santoro, L. E. (2008). Response to Intervention in Reading. RG Research Group, Compass Learning. Retrieved November 4, 2008, from

Foegen, A. (2008). Algebra progress monitoring and interventions for students with learning disabilities. Learning Disabilities Quarterly, 31 (2) 65?78.

Foegen, A., Jiban, C., & Deno, S. (2007). Progress monitoring measures in mathematics: A review of literature. The Journal of Special Education, 41(2), 121?139.

Fuchs, L. S., & Fuchs, D. (2008). What is scientifically-based research on progress monitoring? National Center for Student Progress Monitoring. Retrieved November 4, 2008, from

Graham, S., & Perin, D. (2007). Writing Next: Effective strategies to improve writing for adolescents in middle and high school--A report to Carnegie Corporation of New York. Washington, DC: Alliance for Excellent Education.

Hermitage, M. (December 11, 2008). Formative Assessments. Presentation at the Center on Instruction Mathematics Conference. Long Beach, CA. McMaster, K., & Espin. (2007). Technical Features of Curriculum-Based Measurement in Writing: A Literature Review, The Journal of Special Education, 41(2), 64?84.

Institute for the Development of Educational Achievement. (2002). Executive Summary: Final Report: Analysis of Reading Assessment Instruments for K?3.

National Center on Response to Intervention. (2008). Progress Monitoring. Retrieved November 4, 2008, from blogcategory&id=4&Itemid=54&limit=10& limitstart=10

Roehrig, A. D., Duggar, S. W., Moats, L., Glover, M., & Mincey, B. (2008). When Teachers Work to Use Progress Monitoring Data to Inform Literacy Instruction. Remedial and Special Education (29)6, 364?382. 5

SOUTHEAST COMPREHENSIVE CENTER at SEDL | 800-644-8671 | secc.

Rapid Response REQUEST

Shinn, M. (n.d). Scientifically based progress monitoring using curriculum-based measurement (CBM): General outcome measurement to improve student achievement in Jamestown Reading Navigator.

Stecker, P. M., Fuchs, D., & Fuchs, L. S. (Fall 2008). Progress Monitoring as Essential Practice Within Response to Intervention. Rural Special Education Quarterly, 87568705, 27(4), 1?11.

Thurber, R. S., Shinn, M. R., & Smolkowski, K. (2008). What is measured in mathematics tests? Construct Validity of Curriculum-Based Mathematics Measures. Oregon Research Institute. Retrieved November 5, 2008, from

Westberg, L., McShane, S., & Smith, L. (October 2006). Verizon life span literacy matrix: Relevant outcomes, measures and research-based practices and strategies. National Center for Family Literacy. Retrieved December 16, 2008, from

Additional Resources

AIMSweb Progress Monitoring and RtI System AIMSweb? is a scientifically based, formative assessment system that informs the teaching and learning process by providing continuous student performance data and reporting improvement to parents, teachers, and administrators to enable evidence-based evaluation and data-driven instruction. It is a progress monitoring system based on direct, frequent and continuous student assessment. The results are reported via a Web-based data management and reporting system to determine RtI.

AIMSweb provides its users the assessment materials and ability to organize and report Curriculum-Based Measurement (CBM)--standardized measures of basic skills--including reading, early literacy, early numeracy, mathematics, spelling, and written expression. AIMSweb also has the capacity to organize and report early developmental skills and user-defined measures. AIMSweb reports CBM or DIBELS student progress in a 3-Tier Problem-Solving model, including RtI through Web-based data management and reporting applications to provide a proactive and preventive solution for universal screening and progress monitoring for general education, strategic assessment for remedial programs or at risk, and intensive progress monitoring, including individual education plan (IEP) goals for students with severe achievement problems.

Dynamic Indicators of Basic Early Literacy Skills (DIBELS), University of Oregon DIBELS is widely used for monitoring emerging literacy skills, including those that relate to phonemic/phonological awareness, Initial Sounds Fluency, Phoneme Segmentation Fluency, Nonsense Word Fluency, Oral Reading Fluency. This site allows users to download materials and a training manual at no cost. (Note: Users must sign up for a free materials download account in order to access DIBELS resources.) There are measures for native Spanish-speaking students. The contact information for this resource is as follows the Center on Teaching and Learning, 5292 University of Oregon, Eugene, OR 97403-5292; Phone: 888-497-4290 or 541-346-3108; Fax: 541-346-4349; Office hours: M--F 8:00 a.m.?5:30 p.m. PST; E-mail: support@dibels.uoregon.edu

6

SOUTHEAST COMPREHENSIVE CENTER at SEDL | 800-644-8671 | secc.

Rapid Response REQUEST

Edcheckup This site offers an assessment system for screening student performance and measuring student progress toward goals in reading. Generic passages, which are independent from any particular basal reading series, also may be used to evaluate the effectiveness of reading instruction through the graphing of student reading data. Browsers must pay to view materials from this site.

Edformation Edformation/AIMSweb is a company that markets a full range of CBM services to schools. Schools subscribing to Edformation receive training in the administration of CBM, are supplied with all probes for student monitoring, can store their school CBM data in an online database, and can generate graphs of group and individual student performance. Edformation demonstrates the power of the Internet to make CBM much more feasible as a method of student assessment. This resource is available from Pearson Education Inc., 19500 Bulverde Road, San Antonio, TX 78259; Phone: 800-211-8378.

EdProgress EdProgress focuses on assessment, large-scale testing and accountability, and systemic reform. With research-proven training materials, measurement tools, reporting systems, and teacher training interventions, EdProgress helps teachers become more focused on teaching and learning for all students. Browsers must pay to view materials from this site.

Intervention Central, Curriculum-Based Measurement Warehouse The Curriculum-Based Measurement Warehouse is a Web-based service of Intervention Central. Users can create their own CBM probes and evaluate students' progress, as well as create or download probes for reading fluency, math computation, letter Identification, number Identification, and word lists. (Note: Many of these probes are created dynamically, using Internet applications.)

Iowa State University, Algebra Assessment and Instruction--Meeting Standards (Project AAIMS) Project AAIMS, is a federally funded project that was designed to achieve two objectives related to the teaching and learning of algebra for students with and without disabilities. It is housed in the Department of Curriculum & Instruction in the College of Human Sciences at Iowa State University. First, the researchers examined algebra curriculum, instruction, and assessment for students with and without disabilities and determined the extent to which they were aligned. Second, they developed algebra assessment tools that can be used for monitoring the progress of students with and without disabilities as they learn algebra. Third, they investigated the measures' reliability, validity, and sensitivity to growth. The Web site has information about the activities, research, and products associated with Project AAIMS.

National Center for Family Literacy (NCFL) Family literacy helps parents and children form a learning partnership that ends the cycle of poverty and low literacy. The NCFL works to find solutions to the literacy crisis that build on the family to create a new cycle of ongoing learning and mutual support.

7

SOUTHEAST COMPREHENSIVE CENTER at SEDL | 800-644-8671 | secc.

Rapid Response REQUEST

National Center on Response to Intervention (NCRTI) The NCRTI has many RtI resources posted on its Web site. These progress-monitoring resources are free downloads from their site:

Progress Monitoring rtimanualsection2progressmonitorin.pdf Progress Monitoring is an article written by the National Research Center on Learning Disabilities (NRCLD). It provides an overview of progress monitoring within an RtI model and discusses challenging structures, roles and responsibilities, methods and procedures, an essential task list for progress monitoring, standards for judging quality progress monitoring, and internal resources needed to implement progress monitoring. Activities, tools, and examples are included.

Dialogue Guide: Classroom Assessment and Dialogue Guide: Facilitator Handbook 4&Itemid=54&limit=10&limitstart=10 This 2007 brief and tool were developed to guide stakeholders through dialogue on classroom assessment. The guide includes a brief developed by the IRIS Center to provide an overview of summative and formative assessments and their uses. Also included are six sets of questions for different stakeholders, developed by the IDEA partnership, which ask stakeholders to consider examples of assessments and challenges to progress monitoring. The resources can be used in conjunction with the Dialogue Guide Facilitator's Handbook and the online module developed by the IRIS Center at Vanderbilt University.

National Center on Student Progress Monitoring The National Center on Student Progress Monitoring (NCSPM) is dedicated to the implementation of scientifically based student progress monitoring for grades K?5. The center works to provide technical assistance to states and districts and disseminate information about student progress monitoring practices proven to work in different academic content areas. The NCSPM is a technical assistance and dissemination center funded by the U.S. Department of Education, Office of Special Education Programs. The technical review committee regularly reviews tools and has created a chart of scientifically based tools to measure students' progress. These progress-monitoring resources are listed on its site:

What is Scientifically-Based Progress Monitoring This brief describes how progress monitoring procedures can help teachers track their students' progress in reading, mathematics, or spelling, in order to better identify students in need of additional or different forms of instruction. The document provides an overview of the research and shows experimental evidential support for higher student achievement resulting from progress monitoring. It was presented by Doug Fuchs and Lynn Fuchs and released by the NCSPM.

Choosing a Progress Monitoring Tool that Works for You This 2007 presentation describes a method to help identify needs and goals regarding student progress monitoring. Participants were shown how to use information from the NCSPM review of tools to choose a scientifically based progress-monitoring tool. It was presented by Silvia Wen-Yu Lee and Sarah Short of the NCSPM at the Summer Institute on Progress Monitoring.

8

SOUTHEAST COMPREHENSIVE CENTER at SEDL | 800-644-8671 | secc.

 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download