Purpose

 TOC \h \u \z Table of ContentsPurpose PAGEREF _jhmlo72j0tdq \h 4FOCUS: 2024 PAGEREF _t3xhb0gig0zn \h 4Logistics PAGEREF _levuatf2zd89 \h 42020 WIDA Testing Calendar PAGEREF _7780dcnuiggm \h 4Required WIDA Assessments PAGEREF _2et92p0 \h 4Professional Learning Calendars PAGEREF _tyjcwt \h 4Roles and Responsibilities PAGEREF _u05jsqjdejd \h 5Account Requests PAGEREF _3dy6vkm \h 5Test Integrity PAGEREF _s39vearuuvjd \h 6Test Security Professional Learning PAGEREF _o04sduc183i4 \h 6Accessibility and Accommodations PAGEREF _4d34og8 \h 6Permissible Accessibility and Accommodations PAGEREF _2s8eyo1 \h 6Available to all students, as appropriate PAGEREF _6tdmmvptztmc \h 6Similar to Designated PAGEREF _fdndf99eliwk \h 6For students with an IEP or 504 PAGEREF _hz9locb3ukfm \h 6Prior to Test Administration PAGEREF _17dp8vu \h 7Test Coordinator Responsibilities Prior to Administration PAGEREF _3rdcrjn \h 7Creating Accounts for Managing Online Testing on wida-ams.us PAGEREF _1t3h5sf \h 7Generating the LEP Assessment Report from Infinite Campus PAGEREF _4b9x26s4ppm \h 8Managing Student Rosters and Test Sessions PAGEREF _lnxbz9 \h 8Adding Accommodations in wida-ams.us PAGEREF _4mxfdkxi4i66 \h 8Printing Test Tickets PAGEREF _nfladzbwnfi \h 9Managing Students Transferring within CCSD PAGEREF _ft0inhzf42a1 \h 9Accessing the Practice Test and Sample Items PAGEREF _26in1rg \h 9During Test Administration PAGEREF _jrbsq0vcdx74 \h 9Test Coordinator Responsibilities During Administration PAGEREF _1ksv4uv \h 9Proctor Actions PAGEREF _44sinio \h 10Student Actions PAGEREF _yta3im8ha7e7 \h 10Technology Troubleshooting PAGEREF _b8l9dvl7fht2 \h 10Proctoring Tips PAGEREF _llto445ufulo \h 11Tracking Student Progress Toward Completion PAGEREF _1y810tw \h 12Generating Writing Tier Report PAGEREF _5xgaxp5kcycl \h 12Close of Test Administration PAGEREF _jzy42giyxifn \h 12Test Coordinator Responsibilities Closing Administration PAGEREF _2xcytpi \h 12Verifying All Eligible Students Have Been Assessed PAGEREF _lew8gguevpk7 \h 13Recording Do Not Score Codes PAGEREF _yhwwm6b2jfgb \h 13WIDA Support PAGEREF _c0rgio1n2d6d \h 14Appendix A – 2019-2020 Balanced Assessment System Framework PAGEREF _w0mnnkw1vq5n \h 15Appendix B – Approximate Testing Times 2019-2020 PAGEREF _pcvtcq2351p7 \h 17Appendix C – WIDA Professional Learning Calendar PAGEREF _ecv5yivrivyo \h 19Appendix D– WIDA Readiness Checklist PAGEREF _hyot79kgm0hj \h 20WIDA Readiness Checklist 2019-2020 PAGEREF _ckgxwlg1sv80 \h 20Test Coordinator Responsibilities Prior to Administration PAGEREF _m7540geg7gfh \h 20Test Coordinator Responsibilities During Administration PAGEREF _ownw3z1l0ap4 \h 20Test Coordinator Responsibilities Closing Administration PAGEREF _ty1jogxuldr2 \h 21Appendix E – WIDA Accommodations Framework PAGEREF _ergagc6dj9w \h 22Appendix F – Acknowledgement of Training Form 19-20 PAGEREF _p562i0ep0sh8 \h 23Appendix G – Confidentiality Agreement 19-20 PAGEREF _4vcg02d59iis \h 24Appendix H – What is NOT a TI PAGEREF _fhwveqbw0r7n \h 25Appendix I – What is a TI PAGEREF _tjuwn5sck7p5 \h 26Appendix J – Online Testing Irregularity Checklist PAGEREF _5fopk235vqkj \h 27Appendix K – 2019 WIDA ACCESS 2.0 State Assessments-Datalab Visualization PAGEREF _xaq0f0nrjsz3 \h 28Revisions PAGEREF _jtnzv6z6pz4h \h 30Purpose Administration of the WIDA assessment supports English proficiency for all students and ensures the development of content and language simultaneously. Under the Every Student Succeeds Act (ESSA) of 2015, states and districts are required to assess English proficiency, annually, for identified English Language Learners (ELLs) to ensure that students are making growth toward attaining English proficiency. The following laws, policies, and regulations apply to the WIDA ACCESS test:ESSA Section 1112 (e)(3) Language Instruction. (A) and (B).NAC?388.625 Assessment of pupil’s proficiency in English.NRS?388.407 Board of trustees required to develop policy for instruction to teach English.FOCUS: 2024Use of the WIDA ACCESS assessment is in alignment with CCSD’s Five-Year Strategic Plan, Focus: 2024. Utilization of WIDA data in support of a balanced assessment system to identify student learning needs is one of the strategies aligned to Student Success Priority Area 2: Decrease student proficiency gaps in English language arts, mathematics, and science.Logistics2020 WIDA Testing CalendarTesting WindowTestsGrade LevelJanuary 6, 2020-February 28, 2020WIDA ACCESS for ELLs KindergartenKindergartenJanuary 21, 2020-February 28, 2020WIDA ACCESS for ELLs (Online)1-12January 21, 2020-February 28, 2020WIDA Alternate ACCESS for ELLs (Paper)1-12Required WIDA AssessmentsAll students in Grades K-12, that are identified in Infinite Campus as English learners, are required to participate in the WIDA assessments. The kindergarten WIDA is a paper-pencil test that is administered one-on-one by licensed personnel. The WIDA ACCESS 1-12 is completed online using the Data Recognition Corporation (DRC) INSIGHT testing platform. Please note that Grades 1-3 require a paper booklet for the writing domain. WIDA Alternate ACCESS (WAA) is a paper-pencil test that is administered in Grades 1-12 for students that are identified as English learners and participate in an alternate curriculum and have an annual or placement overall score less than 2.0.Assessment NameGradeApproximate Testing TimeKindergarten ACCESSK45 minutesACCESS Grades 1-31-3Listening 40 minutesReading 35 minutesSpeaking 30 minutesWriting 45-60 minutesACCESS Grades 4-124-12Listening 40 minutesReading 35 minutesSpeaking 30 minutesWriting 45-65 minutesWIDA Alternate ACCESS1-12Listening 20 minutesReading 20 minutesSpeaking 20 minutesWriting 20 minutes Professional Learning CalendarsRegistration is available on the Enterprise Learning Management System (ELMS) at . Usethe keyword WIDA to locate available sessions. For a complete list of professional learning sessions, including playback links and presentation materials, see Appendix C- WIDA Professional Learning Calendar. Roles and Responsibilities WIDA online testing is managed on the WIDA-AMS Web site at wida-ams.us. Educators involved in WIDA test administration are responsible for obtaining online certification at the WIDA Consortium Web site at wida.wisc.edu. System privileges are required for any person involved with test administration of the WIDA assessments. The Assessment Department establishes accounts for school administrators. School administrators will create permissions for other individuals in their buildings. Please reference the following chart which outlines WIDA roles and suggested responsibilities.Note: Some suggested responsibilities might not apply to some user groups depending upon site-based decisions.User GroupSystem PrivilegesSuggested ResponsibilitiesAdministrators Test Coordinators (TC)View students, test sessions, and reports.Set up and conduct testing for students.Print test tickets.Manage shipments.Order additional materials.Manage test sessions.Access tier placement report. Establish schoolwide testing schedules.Provide on-site professional learning.Ensure appropriate accommodations or designated supports are entered correctly for students.Monitor schoolwide assessment completion.Analyze school completion reports after testing window to ensure all students are plete reason not tested at the conclusion of testing window.Ensure all materials are returned to plete any testing irregularities using online system.TeachersNo default permissions in wida-ams.us. TC or administrator must assign each permission.Provide students with the purpose of WIDA before each testing session and monitor student engagement.Provide input for appropriate accommodations or designated supports for students in test sessions.Analyze data to inform instruction.Share data with students and families.Additional Test Administrators (e.g., substitutes)Access student search/view.Additional permissions must be assigned by TC or administrator.Provide students with the purpose of WIDA assessments before each testing session and monitor student engagement during testing.Print and manage test tickets.Technical Coordinator/ Site-Based Technicians (SBT)Set up and conduct online testing for students.Understand the technology requirements for WIDA Assessments.Ensure desktop computers are equipped with the secure DRC INSIGHT lockdown browser.Work with User Support Services (USS) to ensure iPads or Chromebooks are equipped with the DRC INSIGHT testing application. Assist test administrators with technology municate with USS regarding network bandwidth.Ensure labs are equipped with headphones.Account RequestsTo request a training account for the wida.wisc.edu site, send the following information via Gmail to Suraya Hurtado: school name, first and last name of the staff member, and staff member’s Gmail address. For administrators needing access to the wida-ams.us test management system, please email the same information as above to Suraya Hurtado. For wida-ams.us accounts for licensed personnel, the accounts should be created by the school administration using the directions found here.Test Integrity Educators, parents, and other CCSD stakeholders depend on accurate data about student performance. Therefore, the guidelines set forth by the CCSD Plan for Test Administration and Test Security 2019-2020 must be followed to ensure that test security procedures are consistent. Strict adherence to procedures protects the integrity of the state assessment program and ensures consistency in test administration, security of test materials, and the validity of scores. Failure to adhere to CCSD test security procedures may result in state-administered corrective action, including but not limited to invalid scores and/or licensure sanctions. For more information, see the CCSD Plan for Test Administration and Test Security 2019-2020 at bit.ly/TSP_1920. Test Security Professional LearningAll personnel involved in WIDA testing must view the 2019-2020 Online Test Security module available in the Enterprise Learning Management System (ELMS) at .Accessibility and Accommodations To obtain data which reflects students’ true instructional levels, administrative considerations and accommodations (per the Individualized Education Plan (IEP) or 504) must be assigned consistently with what a student receives in his/her normal daily instruction. In addition, documentation (e.g., spreadsheet or online database) is required for any student who receives an administrative consideration or accommodation during WIDA testing. This documentation must be kept on site for 3 years. Permissible Accessibility and AccommodationsPlease refer to the 2019-2020 Accessibility and Accommodations Supplement, available atwida.wisc.edu/sites/default/files/resource/ACCESS-Accessibility-Accommodations-Supplement.pdf. EmbeddedNon-EmbeddedUniversal ToolsAvailable to all students, as appropriate Audio AidsColor ContrastColor OverlayHighlighterKeyboard NavigationLine GuideLow Vision Aids or MagnificationSticky NotesScratch PaperAdministrative ConsiderationsSimilar to Designated Supports-For identified students No embedded administrative consideration available. Adaptive and Specialized Equipment of FurnitureAlternative MicrophoneFamiliar Test AdministratorFrequent or Additional Supervised BreaksIndividual or Small Group SettingMonitor Placement of Responses in the Test BookletParticipate in Different Testing FormatRead Aloud to SelfSpecific SeatingShort SegmentsVerbal Praise or Tangible Reinforcement for On Task or Appropriate BehaviorVerbally Redirect Student’s Attention to the TestAccommodationsFor students with an IEP or 504Extended Speaking Response TimeManual Control of AudioRepeat of AudioBrailleExtended Testing Over Multiple DaysExtended Testing Time Within the School DayHuman Reader for ItemsHuman Reader for Repeat of ItemsHuman Reader for Repeat of Response OptionsInterpreter Signs Test Directions in ASLLarge PrintScribeStudent Responds Using a Recording Device Which is Played Back and Transcribed by the StudentTest May be Administered in a Non-School SettingWord Processor or Keyboarding Device to Respond to Test ItemsSee Appendix E- WIDA Accommodations Framework for a reference. Prior to Test Administration Planning ahead ensures valid results, prepared test administrators, and a positive testing experience for students. Communication with students about the purpose of WIDA testing, along with taking simple steps to manage test sessions, will contribute to a smooth test administration. A complete list of all test coordinator responsibilities through the testing window can be found in Appendix D- WIDA Readiness Checklist.Test Coordinator Responsibilities Prior to AdministrationComplete online certification for WIDA ACCESS testing on the WIDA Consortium Web site at wida.wisc.edu. Receive an 80 percent or better on all quizzes applicable to your level.Review the 2019-2020 School Test Coordinator Manual and 2019-2020 WIDA ACCESS Test Administrator’s Manual. These materials will be sent to your school. They can also be downloaded from the WIDA Consortium Web site at wida.wisc.edu.Attend optional face-to-face professional learning sessions and/or online webinars for test coordinators. See the Professional Learning Calendars for dates and times.Generate the CCSD Custom LEP Assessment Report in Infinite Campus to identify students to test.Create a schoolwide testing schedule, including a process for make-up testing, using the 2019-2020 WIDA Testing municate with the SBT to prepare student devices for testing. Ensure all student devices have been updated with the latest version of the DRC INSIGHT lockdown browser. Confirm volume and headsets are functioning properly for Grades 1-12.Schedule regular technology checks to ensure student devices are optimized for testing.Confirm your school’s network capability, especially if you are testing using devices that rely on Wi-Fi (e.g., Chromebooks, iPads). SBTs can communicate with their manager or User Support Services (USS) to verify that the building Wi-Fi can support testing. Establish schoolwide protocol for addressing technology issues during testing (e.g., SBT will carry a radio during scheduled testing times and remain available to address technology issues). Identify students that require administrative considerations and accommodations to be input into the WIDA-AMS system. Work with special education staff, classroom teachers, and other educators to identify students that require administrative considerations and accommodations.Create a record (e.g., spreadsheet, online database) of all students who need these supports. Manage online testing on the WIDA-AMS Web site at wida-ams.us. Create accounts for all staff that will assist with managing online WIDA testing.Manage Student Rosters and Test Sessions.Enter administrative considerations and accommodations.Print test tickets. Ensure all staff involved in WIDA testing have engaged in professional learning on test administration.Online certification on the WIDA Web site at wida.wisc.edu is required for test administrators.Provide the 2019-2020 WIDA ACCESS Test Administrator’s Manual to all test administrators.Present refresher professional learning sessions and/or provide playback links for online webinars to test administrators. See the Professional Learning Calendars for presentation materials and links. Completion of the 2019-2020 Online Test Security module on ELMS at must be viewed by all staff involved in WIDA testing.Collect signed Acknowledgment of State Assessment Training Form and store for 3 years. See Appendix F – Acknowledgement of Training Form 19-20.Provide the 2019-2020 WIDA Implementation Manual (WIM) to all staff involved in WIDA testing.Ensure all students have an opportunity to engage with the practice test and/or online tools training. Creating Accounts for Managing Online Testing on wida-ams.usOption 1: Add permissions for users who have WIDA-AMS accounts at your school from previous testing administrations.Log on to WIDA-AMS at wida-ams.us. 461962585725Select My Applications > User Management > Edit Single User.Select the administration (e.g., 2018/2019 Interim Assessments) and click Find User.Click on the View/Edit icon next to a user that you want to update.Click Add.Select the Administration (e.g., 2019/2020 Interim Assessments).Select School for both User Role and Permission-set.Use the double right arrow to add all highlighted permissions. Note: The Administrator permission allows users to add or edit user accounts and profiles. The Students-Add/Edit permission allows users to add accommodations and designated supports for students. Assign the Administrator and Students- Add/Edit permissions conservatively and communicate that student demographic information should never be changed.Click Save.4438650100965Option 2: Create new accounts. 4572000812800457200081280045720007239004572000723900Select All Applications > User Management > Add Single User. Fill in the fields: First Name, Last Name, and Email Address (CCSD Google). Select the Administration. Select School for both User Role and Permission-set.Use the single right arrow to add the highlighted permissions.Ensure permissions shown here under Available Permissions are NOT found in the Assigned Permissions. Note: The Students-Add/Edit permission allows users to add accommodations and designated supports for students. Assign this permission conservatively and communicate that student demographic information should never be changed. Click Save.Generating the LEP Assessment Report from Infinite Campus School administrators log into Infinite Campus at . 337661366675Click on Index > CCSD Custom Reports. Select Assessments > LEP Assessment Report.Select Generate Report.Managing Student Rosters and Test SessionsGeneric test sessions will be created by the Data Services Department for each grade level. Students must not be added to the WIDA-AMS System by school personnel since the process will be managed by Data Services. Avoid creating custom test sessions. If this is done, please know it will add time to the transfer process. If you would like to test your students by teacher or period, we recommend sorting test tickets printed from the generic test sessions. Adding Accommodations in wida-ams.usNote: Accommodations must be entered prior to printing test tickets.417807195359Log on to WIDA-AMS at wida-ams.us.Select All Applications > Student Management > Manage Students.Select the Administration. Search for students by either Name, Grade, Domain or Session. Then select Find Students.42672000Once you have found the student, select the View/Edit icon. Select Accommodations. The accommodations available on the WIDA ACCESS 2.0 will be displayed on the next screen. The only embedded (provided in the online platform) accommodations are Manual control of item audio (MC), Repeat item audio (RA), and Extended speaking test response time (ES). Other accommodations (non-embedded) may be selected using this page to document student’s use during testing.4257675885755When all appropriate accommodations have been selected, click Save.Printing Test TicketsPrint test tickets after January 13, 2020, as Data Services will be uploading a current student file to correctly place all students who have transferred since December 20, 2019. Note: Accommodations must be entered prior to printing test tickets.3390900133350Log on to WIDA-AMS at wida-ams.us.Select All Applications, Test Management, then Manage Test Sessions.Select NV ACCESS for ELLs 2.0 – 2019-2020 in the Administration dropdown. To view a specific test session, include that information then select Show Sessions.To print all tickets for a session, select the printer icon. To print tickets for individual students, select the Edit/Print ticket status icon.To print tickets for specific students, click the check box next to each name, then select Print Selected. This screen also provides information about the testing status of each student.Managing Students Transferring within CCSDAARSI will manage students transferring within our district beginning on Tuesday, January 22, 2020. Students who move to another school will be manually transferred throughout the test window. Verify that new students have been added to your test sessions every Monday and Thursday prior to printing test tickets. Your patience is appreciated during this time. If you have questions about a student transfer, please contact Suraya Hurtado at (702) 799-1041, Ext. 5966.Accessing the Practice Test and Sample ItemsBefore administering WIDA, students should have opportunities to engage with the practice test to learn how to navigate the assessment and access the universal tools (when appropriate).Launch the DRC INSIGHT Lockdown Browser or access it on the WIDA-AMS Web site at wida-ams.us.Click Test Practice and enter the username and password.Select the appropriate grade and the desired test domain. Additional student preparation tips can be found on the WIDA.Us Web site at wida.wisc.edu/assess/access/preparing-students. The WIDA Consortium also produced a webinar regarding speaking domain scoring: portal.wida.us/GetResource/2457. You will need to login to access this webinar.During Test AdministrationA smooth test administration with engaged proctors and students is key to collecting actionable data to inform differentiated instruction.Test Coordinator Responsibilities During AdministrationEnsure your SBT has checked technology at least 3 days prior to testing to confirm functionality of the DRC INSIGHT lockdown browsers and is following your school’s protocol for addressing technology issues.Provide professional learning for any substitute or new teachers.Remind test administrators to prepare students for testing by:Discussing the purpose of WIDA testing and the use of data. Providing opportunities to engage with the practice test.Establish a system for distribution and collection of secure testing materials. Monitor that all test administrators and proctors are following test security and administration protocols. This should be done frequently throughout the testing window. Ensure you are reporting testing irregularities using the Nevada Department of Education (NDE) online tool within 14 days at bit.ly/OnlineTI.Use the Online Testing Irregularity Checklist to help with collecting the necessary information and supporting documentation prior to completing the new online testing irregularity form. Once started, the form must be completed in its entirety and submitted. Upload a spreadsheet for three or more students affected by the incident including Last Name, First Name, State ID and Date of Birth. Template can be found at bit.ly/TIStudentTemplate.Frequently check the LEP Assessment report for new students.New students will populate into the WIDA-AMS system within 24-48 hours of enrollment and will be added into existing generic test sessions by AARSI personnel. Look for transfer students in WIDA-AMS on Mondays and Thursdays after January 21, 2020. Contact Data Services at (702) 799-1041, option 1, if you have any rostering issues, or submit a Quick-IT.For Grades 1-3 only: call the test coordinator at the previous school to determine if a transfer student in Grades 1-3 has completed the writing test. Track student progress toward test completion on WIDA-AMS at wida-ams.us. This should be done frequently throughout the testing window. Grades 1-3 only: Generate writing tier report for paper writing test. Proctor ActionsOn the day of testing, the proctor is responsible for following state and district test security and administration guidelines including:Reading the test administrator’s script verbatim. Assisting students with logging into the test and understanding test directions. No assistance can be given with test content.Managing secure test materials, including test tickets, test booklets, student rosters, etc., appropriately. Monitoring student engagement throughout the testing session by engaging in active proctoring.Maintaining a secure testing environment free from distractions. Providing brief breaks as indicated by the test administrator’s script or as needed. Student Actions On the day of testing, students are responsible for giving their best effort, including: Launching the DRC INSIGHT secure testing browser or app on testing devices.Entering the username and password provided on the test ticket to sign into the test. Notify the test administrator or proctor if headsets are not working.Ensure test ticket is returned to the test administrator or proctor. Technology TroubleshootingAt times, students may experience difficulty logging into the test or experience technology interruptions. Test administrators and proctors can easily troubleshoot difficulties. Use the chart below for common troubleshooting solutions. IssueResolutionInternet/Network Connection Error:There was an error in the network or internet connection and the testing device cannot reach DRC servers and/or the COS Service Device.Contact your SBT.Invalid Username or Password.Return to the main menu. Verify if the student is logging into the correct test location. Have the student re-enter the username and password.Connection Retry is in Progress:DRC INSIGHT cannot send a response to DRC due to a connectivity issue.Wait. The message will remain until the connection is reestablished, until 5 minutes have elapsed, or until the student clicks the Exit the Test button. If the issue persists after 5 minutes, contact your school’s SBT.Connection Error Retrieving Content:Testing Device cannot connect to the COS Service Device to access the test content.Contact your SBT.Configuration Not Found/Configuration Error:The testing device is not registered to the Device Toolkit and cannot proceed with testing until assigned an ORG Unit ID.Contact your SBT.No Audio.Check the volume level on the testing device and increase it if possible.Verify that the headphones or headset is connected correctly. If DRC INSIGHT doesn’t recognize that the headphones or headset has been connected, close the program and sign back in.Contact your SBT.Frozen or gray screen with spinning wheel.Close DRC INSIGHT and reboot the testing device.The record button is grayed out.The student has already recorded a response and must proceed to the next screen. The Next button is grayed out.The student must respond to the question before proceeding to the next screen.For all other error messages, contact your SBT.Proctoring TipsTest administrators and proctors must monitor students to ensure they are working independently and adhering to procedures. It is not appropriate to engage in other activities (e.g., grading assignments, checking e-mails) during test administration.Active Proctoring:Test Administrators must be actively engaged at all times while students are testing. This includes walking around the room; verifying students are engaged and following testing procedures; and ensuring the testing platform is functioning properly (if applicable) to minimize any irregularities in test administration and test security. Accidently Submitting the Assessment:Establish a dialogue with students on how to properly exit an assessment. Ask students to raise their hand prior to ending and submitting as this will ensure students do not accidently submit the assessment too soon. Once the student clicks on End Test, the assessment is considered completed and will be submitted for scoring.Selecting the Correct Test Domain:It is a possibility that students may click on the wrong assessment. For example, students could select Listening rather than Reading. In order to minimize this error, it is suggested that proctors check each student’s screen while they navigate the instructions and ensure students are logged into the proper assessment. It is important to note that if the parts were taken out of order, students will need to complete whichever part of the test that was started.Distributing Test Tickets:It is a testing irregularity when a student tests with another student’s test ticket or an inaccurately assigned accommodation. It is recommended that the proctor physically hand the test ticket to each student while simultaneously verifying student ID, test, and accommodations (if applicable) from the Student Test Roster report, which prints with the test tickets. Collecting Test Tickets:Test tickets are secure materials. Once every student has logged in to the correct test, it is recommended that the proctor pick up each test ticket. This will prevent students from beginning a test they should not have started. Verify Technology is Functional:Ensure headphones are in working condition and check computer connectivity prior to testing. Technical Assistance:If you experience a technical issue while administering an assessment, call your SBT first. If your SBT is not available, call User Support Services (USS) and then the DRC Helpdesk, if necessary, to report the situation. Make sure you obtain a ticket service number for tracking purposes. For a one-page printable document that can be shared with teachers, please see Appendix M: Proctoring Tips for Test Administrators (Teachers). Tracking Student Progress Toward CompletionSchools are able to monitor student status during the assessment window to ensure all students are assessed. Option 1: Monitoring student status in WIDA-AMS.340042559389Log on to WIDA-AMS at wida-ams.us.Select All Applications > Student Management > Student Status Dashboard.Search for a school by name or code and select in the drop-down menu.443865068580443865068580Select WIDA ACCESS for ELLS 2.0-EW0804 to access student testing status.View the student status visualizations. Student status is color-coded: Not Started, In Progress, and Completed. Select Export to CSV below the graph area to generate a spreadsheet. Note: Grades 1-3, a session will not be listed for writing because these students will be completing the writing domain in a paper writing booklet.Option 2: Monitoring student status in Datalab.Log on to CCSD Datalab at . Select 1 – CCSD > WIDA Status Update > Student Participation Status WIDA.Select Download > Crosstab to generate a spreadsheet.Generating Writing Tier ReportFor students in Grades 1-3, performance on the listening and reading tests will determine which tier the students will take on the paper writing test. Students will take either a Tier A or Tier B/C writing test.Login to the wida-ams.us site, select All Applications>Test Management>Manage Tests Sessions>Show Sessions.224790066675Click on the pencil and paper icon on the right side of the grade level test session.2647950342900The writing tier is listed on the next to last column on the right hand side of the report.Close of Test Administration It is vital that educators close out the test administration window so that all students receive valid, reliable results.Test Coordinator Responsibilities Closing AdministrationVerify that all eligible students have been assessed with the correct assessment. Record do not score codes in WIDA-AMS for students not tested. Account for all materials received from DRC and complete the materials accountability form for any missing materials.Ensure all test booklets are correctly labeled and bubbled.Return all test materials in the yellow DRC boxes by March 6, 2020. You may combine materials into one box for return. Call UPS for a pickup date once the box is ready to ship.Retain all testing documents for three years. This includes school test security plans, professional learning sessions, testing logs, irregularity reports, and evidence from investigations.Shred test tickets and scratch paper.Provide opportunities for teachers to view and analyze reports to guide instruction.Assist educators on how to communicate results with students and parents/guardians in order to set instructional and growth goals.Verifying All Eligible Students Have Been AssessedEnsure that all eligible students have been assessed by viewing the Student Status Dashboard in WIDA-AMS or Summative Status Update in Datalab. See the Tracking Student Progress Toward Completion section for step-by-step directions.Recording Do Not Score CodesEligible students that did not participate in testing must have a Do Not Score code entered for accountability purposes. Do Not Score codes should be entered for every test that has a Not Started status.Select All Applications, Student Management and Manage Students. 383857560960In the Administration dropdown, select NV ACCESS for ELLs 2.0 - 2019-2020.In the Online Testing Status dropdown, filter for Not Started. Click the Find Students button. 2390775123825Click the View/Edit icon in the Action column for the student.In the Edit Student window, select the Do Not Score tab and select a code from the drop down menu for each domain.Click Save.ReasonCodeStudents not enrolled during the test window.No action is needed.Students that attempted to test but have been absent.Mark Absent (ABS).Invalidate (INV) is for instances of cheating, etc, and should never be marked by the school.For Assessment use only.Students that refuse to test.Mark Declined (DEC).Students whose disability prevents them from completing a domain, such as listening for a deaf student.Mark Deferred Special Education/504 (SPD).Datalab2019-2020 WIDA results will be available in Datalab upon release of scores by the Nevada State Department of Education and the completion of imported scores into Infinite Campus (IC). Educators and school leadership teams can utilize this high-level data to identify trends over time and guide decision-making regarding allocation of resources to improve student success. Two workbooks provide WIDA data visualizations: State Assessments Workbook: for more information on using results from WIDA to better understand instructional strengths and areas of opportunity, see Appendix K – 2019 WIDA ACCESS 2.0 Appendix K– State Assessments-Datalab Visualization guide.Assessment Growth Workbook: for more information on using student growth data to engage in productive conversations with actionable next steps, see Appendix L – 2019 State Summative Assessment Growth Workbook-Datalab Visualization: Criterion-Referenced Tests (CRT) and WIDA ACCESS 2.0.Instructional ConnectionsEducators and school leadership teams can use WIDA can-do descriptors and rubrics to help align curriculum, instruction, and assessment in support of increased student achievement and growth.Data to InstructionUsing WIDA Data to Inform InstructionPresentation and materials that can be used to explore how WIDA data can be used to guide instructional decisions within the CCSD BAS Framework, understand and experience the success criteria for grade level mastery within the speaking domain, and how to use this information to increase success for all students. Accessing, Archiving, and Distributing Student Score ReportsDRC sends, via U.S. mail, color paper copies of individual student score reports to schools. Schools will receive printed individual student score reports from DRC after (date TBD). Individual student score reports must be sent to families within 15 days of receipt per the Nevada Department of Education Test Security Procedures manual.Log in to WIDA-AMS.us.Go to All Applications > Report Delivery > Test Results > Administration > Student Reports.Maintain a copy (digital or hardcopy binder) of the individual student reports per Family Educational Rights and Privacy Act (FERPA) law and state guidelines.Distribute the results to each student within 15 business days of receipt to the parent or legal guardian of the student. For currently enrolled students, results may be given to the student by the classroom teacher to take home to the parent/guardian. For students no longer at a site, results must be mailed by the school receiving the shipment from DRC to the last known address. WIDA SupportAssistance and support is available to help schools maximize the benefits of WIDA. The following chart helps determine the best way to answer a question or find a solution. ContactSupport Assessment Department: (702) 799-1041, option 2Data analysis support.Professional learning options.Test administration assistance.Student data transfers (students transferred schools during the testing window).Data Services Department: (702) 799-1041, option 1Rostering issues.DRC Technical Support: (855) 787-9615 Problems with the DRC INSIGHT Testing PlatformTechnical Assistance.User Support Services (USS): (702) 799-3300 Device support for installation of the DRC INSIGHT testing system. Wi-Fi or Internet connectivity questions or concerns.WIDA Client Services (866) 276-7735Professional learning user accounts.Assessments.Instructional resources.Professional learning and research.Appendix A – 2019-2020 Balanced Assessment System Framework190503810019050171450Appendix B – Approximate Testing Times 2019-2020319123104775 35307171450Appendix C – WIDA Professional Learning CalendarProfessional LearningDateTimeLocationKeywordsUsing WIDA Data to Inform InstructionPresentation link: bit.ly/UsingWIDADataOctober 15, 2019October 16, 2019October 23, 2019November 19, 20198:00 a.m.-11:00 a.m. CPDWIDA DataWIDA Preparing for Administration Playback link: 11, 2019 8:00 a.m.-8:30 a.m. On-demandSaba Webinar WIDA Preparing Administering the WIDA Kindergarten Annual Assessment Presentation Link: bit.ly/WIDAKinderPPTDecember 3, 2019 December 5, 2019 December 10, 2019 December 12, 2019 December 17, 2019 *Please see ELMS for specific times and locations.Kindergarten ACCESS Administering the WIDA Alternate Assessment Presentation Link: bit.ly/WAAPresentationNovember 19, 2019 December 4, 2019 WIDA Alternate WIDA Test Administration Overview Presentation Link: January 15, 2020 January 16, 2020 WIDA Test Administration WIDA Sound Test Administration Open Lab Presentation Link: January 15, 2020 January 21, 2020 WIDA Open Lab WIDA Guidance During the Administration Playback Link:February 4, 2020 8:00 a.m.-8:30 a.m. On-demandSaba Webinar WIDA Guidance WIDA Closing the AdministrationPlayback Link: February 20, 2020 8:00 a.m.-8:30 a.m. On-demandSaba Webinar WIDA Closing Appendix D– WIDA Readiness ChecklistWIDA Readiness Checklist 2019-2020This checklist provides test coordinators an outline of steps to complete prior to, during, and at the close of administration of the WIDA ACCESS 2.0, the Kindergarten ACCESS and the WIDA Alternate ACCESS (WAA). Test Coordinator Responsibilities Prior to AdministrationComplete online certification for WIDA ACCESS testing on the WIDA Consortium Web site at wida.wisc.edu. Receive an 80 percent or better on all quizzes applicable to your level.Review the 2019-2020 School Test Coordinator Manual and 2019-2020 WIDA ACCESS Test Administrator’s Manual. These materials will be sent to your school. They can also be downloaded from the WIDA Consortium Web site at wida.wisc.edu.Attend optional face-to-face professional learning sessions and/or online webinars for test coordinators. See the Professional Learning Calendars for dates and times.Generate the CCSD Custom LEP Assessment Report in Infinite Campus to identify students to test.Create a schoolwide testing schedule, including a process for make-up testing, using the 2019-2020 WIDA Testing municate with the site based technician (SBT) to prepare student devices for testing. Ensure all student devices have been updated with the latest version of the DRC INSIGHT lockdown browser. Confirm volume and headsets are functioning properly for Grades 1-12.Schedule regular technology checks to ensure student devices are optimized for testing.Confirm your school’s network capability, especially if you are testing using devices that rely on Wi-Fi (e.g., Chromebooks, iPads). SBTs can communicate with their manager or User Support Services (USS) to verify that the building Wi-Fi can support testing. Establish schoolwide protocol for addressing technology issues during testing (e.g., SBT will carry a radio during scheduled testing times and remain available to address technology issues). Identify students that require administrative considerations and accommodations into the WIDA-AMS system. Work with special education staff, classroom teachers, and other educators to identify students that require administrative considerations and accommodations.Create a record (e.g., spreadsheet, online database) of all students who need these supports. Manage online testing on the WIDA-AMS Web site at wida-ams.us. Create accounts for all staff that will assist with managing online WIDA testing.Managing Student Rosters and Test Sessions.Enter administrative considerations and accommodations.Print test tickets. Ensure all staff involved in WIDA testing have engaged in professional learning on test administration.Online certification on the WIDA Web site at wida.wisc.edu is required for test administrators.Provide the 2019-2020 WIDA ACCESS Test Administrator’s Manual to all test administrators.Present refresher professional learning sessions and/or provide playback links for online webinars to test administrators. See the Professional Learning Calendars for presentation materials and links. Completion of the 2019-2020 Online Test Security module on ELMS at must be viewed by all staff involved in WIDA testing.Collect signed acknowledgment of state assessment training form and store for 3 years.Provide the 2019-2020 WIDA Implementation Manual (WIM) to all staff involved in WIDA testing.Ensure all students have an opportunity to engage with the practice test and/or online tools training.Test Coordinator Responsibilities During AdministrationEnsure your SBT has checked technology at least 3 days prior to testing to confirm functionality of the DRC INSIGHT lockdown browsers and is following your school’s protocol for addressing technology issues.Provide professional learning for any substitute or new teachers.Remind test administrators to prepare students for testing by:Discussing the purpose of WIDA testing and the use of data. Providing opportunities to engage with the practice test.Establish a system for distribution and collection of secure testing materials. Monitor that all test administrators and proctors are following test security and administration protocols. This should be done frequently throughout the testing window. Ensure you are reporting testing irregularities using the Nevada Department of Education (NDE) online tool within 14 days at bit.ly/OnlineTI.Frequently check the LEP Assessment report for new students.New students will populate into the WIDA-AMS system within 24-48 hours of enrollment and will be added into existing generic test sessions by AARSI personnel. Look for transfer students in WIDA-AMS on Mondays and Thursdays after January 21, 2020. Contact Data Services at (702) 799-1041, option 1, if you have any rostering issues.For Grades 1-3 only: call the test coordinator at the previous school to determine if a transfer student in Grades 1-3 has completed the Writing test. Track student progress toward test completion on WIDA-AMS at wida-ams.us. This should be done frequently throughout the testing window. Grades 1-3 only: Generate writing tier report for paper writing test. Test Coordinator Responsibilities Closing AdministrationVerify that all eligible students have been assessed with the correct assessment. Record do not score codes in WIDA-AMS for students not tested. Account for all materials received from DRC and complete the materials accountability form for any missing materials.Ensure all test booklets are correctly labeled and bubbled.Return all test materials in the yellow DRC boxes by March 6, 2020. You may combine materials into one box for return. Call UPS for a pickup date once the box is ready to ship.Retain all testing documents for three years. This includes school test security plans, professional learning sessions, testing logs, irregularity reports, and evidence from investigations.Shred test tickets and scratch paper.Provide opportunities for teachers to view and analyze reports to guide instruction.Assist educators on how to communicate results with students and parents/guardians in order to set instructional and growth goals.Appendix E – WIDA Accommodations Framework1905038100Appendix F – Acknowledgement of Training Form 19-20Appendix G – Confidentiality Agreement 19-20-1333490Appendix H – What is NOT a TI285750485775Appendix I – What is a TI19050114300Appendix J – Online Testing Irregularity ChecklistPurposeTesting irregularity (TI) reports go directly to the Nevada Department of Education (NDE) through a secure online portal. Use this checklist to collect the necessary information and supporting documentation prior to completing the new online testing irregularity form. Once started, the form must be completed in its entirety and submitted.Collecting Incident DetailsVerify the testing irregularity; consult the CCSD Plan for Test Security and AdministrationGather information to write a detailed narrative (i.e., how it occurred, by whom it was discovered, the outcome, school site corrective action)Gathering Incident Details – If ApplicableAll supporting evidence must be attached as a zip file. Examples of supporting documents include:School Test PlanStaff Training LogsSpreadsheet of three or more students affected by the incident including Last Name, First Name, State ID and Date of Birth (Template can be found at bit.ly/TIStudentTemplate).Statements from any person involved in the testing irregularity (i.e., test coordinator, proctor, student witness, nurse, SBT, etc.)Confiscated papers, photos, etc. All testing irregularities must be submitted through the online form, within 14 days, at bit.ly/OnlineTISubmitting the FormAll testing irregularities must be submitted through the online form, within 14 days, at bit.ly/OnlineTIIf you need assistance, please contact the Assessment Department at (702) 799-1041.Brian Daw Ext. 5362Christine Mamaradlo-Rodriguez Ext. 5280Dawn Burns Ext. 5258Heath Horvat Ext. 5228Michele Rhine Ext. 5957Judy Milligan Ext. 5834Rebecca Meyer, Director, Ext. 5308Appendix K – 2019 WIDA ACCESS 2.0 State Assessments-Datalab VisualizationBeginning August 13, 2019, four years of WIDA ACCESS 2.0 data will be available for viewing, comparing, and analyzing to inform curricular and instructional decisions. Understanding WIDA DataWIDA data can be used to identify trends over time and guide decision-making regarding allocation of resources to improve student success. Datalab visualizations, found at , provide easy access to view and analyze summative data.As part of a balanced assessment system, results from WIDA provide data to better understand strengths and areas of opportunity at each of the following levels: school, grade, department, and student.Overall results are reported as follows: Reaching (Level 6), Bridging (Level 5), Expanding (Level 4), Developing (Level 3), Emerging (Level 2), and Entering (Level 1). Accessing WIDA DataTwo Types of student roster reports are available:State Assessments – Current Rosters provides scores for students currently enrolled in the user’s school for the 2019-2020 school year.State Assessments - Historical Rosters provides results for students who participated in previous test administrations.Log in to Datalab using your Active Directory (AD) username and password.Select 1 – CCSD > State Assessments – Current Rosters or State Assessments - Historical Rosters.Select a workbook.Filter data by using the options to the right of the screen. Please note: Types of filters vary depending on the tab chosen within the workbook.As filters are selected, be sure to select Apply when the option appears. 666759525Selecting Workbook TabsWithin the workbook, there are six available tabs:User Guide: Electronic manual which describes Datalab definitions, layout, navigation, and tab details for the chosen workbook.Overall Results: Displays overall results for the chosen school compared to the Clark County School District based upon chosen filters. Results by Teacher: View achievement or proficiency levels by teacher name or course titled. Subtest Results: View domain-level data according to selected filters (e.g., teacher name, school, grade level, ethnicity, etc.) Student Results: Displays individual student results by teacher (student number, assessment name, scale score, overall proficiency level, and domain-level results.) Download Results: Export all student-level results to an Excel file. Select Download in the top right corner of the screen and Crosstab from the pop up menu. Analyzing WIDA DataWIDA ACCESS 2.0 is part of CCSD’s Balanced Assessment System. Teacher Teams (e.g., classroom and content area teachers and strategists) and Leadership Teams (e.g., administrators, strategists, department chairs, etc.) analyze summative data to inform decision-making. Teams may use the guiding questions in the following table to drive data-based discourse. Historical Data:Informing Critical Schoolwide DecisionsCurrent Data:Informing Next Steps for Instructional Decisions-38099-66674Teacher Teams-38099-66674View results for the previous four years (if applicable) by selecting multiple years in the Assessment Name dropdown.· Which domains(s) are areas of strength/focus for teacher professional growth based on trends?· Are all groups of students showing similar rates of achievement within domains?· What additional assessment, curricular, and instructional supports are needed?· What professional learning is needed for chosen areas of focus?-28574-66674Teacher Teams-28574-66674View 2019 WIDA ACCESS 2.0 results for currently rostered students based on chosen filters.· How many students exited (reached a 4.5 overall proficiency level) last year?· Is there a domain not showing steady improvement year to year? How can I scaffold my instruction to target this domain?· In which domain(s) have my students not reached proficiency? How can I use the Can Do Descriptors to meet students’ needs?· What additional data do I need to differentiate instruction for long term English learners vs. newcomers? -38099771525Leadership Teams-38099771525View Overall Results for multiple years.· What trends are observed in achievement levels? Are trends visible within specific domains?· Are there observable trends showing an area of strength for a grade level?· Are there observable trends showing an area of focus for a grade level?· Are all groups of students showing similar rates of achievement or growth?· What resources or professional learning are needed for Leadership Teams or Teacher Teams? -47624-66674Leadership Teams-47624-66674View 2019 summative results based on chosen filters.· What domains are areas of strength and areas of focus?· How do the results compare to what was observed in Historical Roster results?· Do domains show similar results as seen in the Historical Roster results?· What does current data show for various groups of students?· What additional data is needed to meet the needs of all students through differentiated instruction?· What resources and professional learning are needed to increase student performance?ResourcesUse the website for professional and instructional learning resources to target areas of improvement, to access quick tutorials on navigating workbooks for summative data analysis. For support please reach out to the Assessment Department at (702)799-1041, option 2. Appendix L – 2019 State Summative Assessment Growth Workbook-Datalab Visualization: Criterion-Referenced Tests (CRT) and WIDA ACCESS 2.0.Beginning August 13, 2019, schools will have access to Historical Roster Growth Results containing the newly released 2018-2019 data for the CRTs and WIDA. This guide provides steps on how to access growth visualizations in Datalab to engage in productive conversations with actionable next steps. For additional information on Datalab navigation, please view the corresponding quick video at bit.ly/Datalabvids.Understanding Summative DataSummative data used with other assessments inform school and grade level/content area decision-making regarding instruction and allocation of resources.Median Growth Percentile (MGP) compares students against their academic peers, other students who scored similarly on the previous year’s assessment.Adequate Growth Percentile (AGP) is a projected target students must meet annually to become proficient.CRT: within three years or by 8th grade.WIDA: within five years or by 12th grade.Available Datalab ViewsTwo types of student roster reports are available and defined below:Assessment Growth Workbook - Current Rosters provides scores for students currently enrolled in the user’s school for the 2019-2020 school year.Assessment Growth Workbook - Historical Rosters provides results for students who participated in the CRT and WIDA for previous test administrations.Selecting Workbook TabsAccess Datalab at using your Active Directory (AD) username and password. Select 1-CCSD, Assessment Growth Workbook - Current Rosters or Assessment Growth Workbook - Historical Rosters and then select a workbook. Accessing Assessment Growth ResultsFilter data by using the options on the right side of the visualization. Below are descriptions of the available filters. Some filters may not be available on every dashboard.532447566675Assessment Name: Select SBAC or WIDA for the desired year.School Name: Select the name of the school(s) if the user has access to more than one school.Grade: Select the checkbox for the desired grade(s).Year in School: Select “Yes” to display data for students who qualify for Year in School, participation, and have a score in achievement levels. Select “Yes” and “No” to view all students whether they fit the previous criteria or not.Select Right Measure: Select either Met Growth Target or Current Achievement Level to change the Sankey Diagram. (Available only in Assessment Growth Workbook - Historical Rosters.)Select Apply when choosing filters.Analyzing Growth DataThe Datalab Assessment Growth Workbook can be used to facilitate conversations using growth data as part of a Balanced Assessment System to inform school and grade level/content area decision-making regarding instruction and allocation of resources. MGP by TeacherDescription:231457576200This dashboard contains Median Growth Percentiles (MGP) by teacher (top of the page). 2305050180975The Sankey Diagram (bottom of the page) displays comparisons between prior achievement levels and current achievement levels.Questions:Are there any teachers who have a significantly higher MGP than others? Did the teacher implement a resource, support, or strategy that can be implemented school wide?What do you observe when looking at the Sankey Diagram?Are there significant changes in achievement levels from year to year?MGP vs. AGP by TeacherDescription:1628775142875This dashboard displays MGP and Adequate Growth Percentiles (AGP) by teacher. In addition, MGP and AGP are also displayed to show comparisons between the chosen school and the Clark County School District (CCSD).Questions:How does your school’s MGP and AGP compare to CCSD?What is observed when comparing the MGP/AGP of individual teachers?What resources can be offered to assist teachers in support of increasing achievement for all students?MGP by SubgroupDescription:2457450152400MGPs for disaggregated groups of students in the school and in CCSD are displayed. The width of the bars represents the size of the population in the disaggregated group. Questions:How does the performance of disaggregated groups of students at the school compare to that of disaggregated groups of students in CCSD?Are there any noticeable differences between the performance of disaggregated groups of students?Are there disaggregated groups that should be considered for specific targeted support?Met AGP by SubgroupDescription:228600085725The percentages of students within disaggregated groups who have either met or not met their AGP targets are displayed. The height of the brown bar represents the size of the population within the disaggregated group.Questions:How do disaggregated groups at the school compare to disaggregated groups in CCSD?Are there any noticeable differences between disaggregated groups?Are there disaggregated groups that should be considered for specific targeted support?If you would like additional assistance with navigating Datalab or with data analysis, please contact the Assessment Department at (702)799-1041, option 2.Appendix M – Proctoring Tips for Test Administrators (Teachers)PurposeThis guide provides test administrators and proctors with helpful tips to minimize errors in test administration to ensure valid and reliable student results.TipsActive ProctoringTest Administrators must be actively engaged at all times while students are testing. This includes walking around the room, verifying students are engaged and following testing procedures, and ensuring the testing platform is functioning properly (if applicable) to minimize any irregularities in test administration and test security. Accidently Submitting the AssessmentEstablish a dialogue with students on how to properly exit an assessment. Ask students to raise their hand prior to ending and submitting as this will ensure students do not accidently submit the assessment too soon. Once the student clicks on End Test, the assessment is considered completed and will be submitted for scoring.Selecting the Correct Test PartStudents can take tests out of order. If a student clicks on a different test part than directed by the test administrator, have the student complete that part. For example, a student might select PT 2 Writing rather than PT 1 Reading. Proctors can avoid this by checking each student’s screen while they navigate the instructions to ensure students are logged into the proper assessment.Distributing Test TicketsIt is a testing irregularity when a student tests with another student’s test ticket or an inaccurately assigned accommodation. It is recommended that the proctor physically hand the test ticket to each student while simultaneously verifying student ID, test, and accommodations (if applicable) from the Student Test Roster report, which prints with the test tickets. Test Coordinators can print the report from eDIRECT: All Applications > Test Management > Manage Test Sessions > Show Sessions. Select the Session and the Edit/Print Ticket Status button then Print All.Collecting Test TicketsTest tickets are secure materials. Once every student has logged in to the correct test, it is recommended that the proctor pick up each test ticket. This will prevent students from beginning a test part not scheduled for that day.Verify Technology is FunctionalEnsure headphones are in working condition and check computer connectivity prior to testing. Check that the INSIGHT lockdown browser has been updated. Technical AssistanceIf you experience a technical issue while administering an assessment, call your Site Based Technician (SBT) first. If your SBT is not available, call User Support Services (USS) and then the DRC Helpdesk, if necessary, to report the situation. Make sure you obtain a ticket service number for tracking purposes. CCSD User Support ServicesNevada DRC Helpdesk(702) 799-3300(866) 588-4978RevisionsThe Assessment Department is committed to ensuring the best experience for users. In the event any part of this implementation manual requires a revision, please refer to the table below for details. Revision NumberRevision DateNature of RevisionPage Number112/4/19Addition of Testing Irregularity SamplesAddition of TI SpreadsheetPresentation link for Using WIDA Data to Inform InstructionPages 25-26Page 10Page 19 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download