RFA-19: California High School Proficiency Exam (CA Dept ...



California High School Proficiency ExaminationRequest for Applications for Tests Designed to Measure the Basic Skills Taught in California Public High Schools for Possible Use as the California High School Proficiency ExaminationDue December 10, 2019, at 4 p.m.California Department of EducationAssessment Development and Administration Division1430 N Street, Suite 4409Sacramento, CA 95814ADADFiscalSupport@cde. HYPERLINK "" \o "California High School Proficiency Examination" This page is intentionally left blank.Contents TOC \o "1-3" \h \z \u 1.Purpose PAGEREF _Toc14760280 \h 12.Background PAGEREF _Toc14760281 \h 13.Citation of Applicable Laws and Regulations PAGEREF _Toc14760282 \h 24. Application Contents PAGEREF _Toc14760283 \h 3A. Cover Sheet PAGEREF _Toc14760284 \h 3B. Test Information PAGEREF _Toc14760285 \h 3C. Testing Time by Content Area PAGEREF _Toc14760286 \h 4D. Test Primary Purpose and Uses PAGEREF _Toc14760287 \h 4E. Equating Methodology PAGEREF _Toc14760288 \h 4F. Alignment with the California Common Core State Standards PAGEREF _Toc14760289 \h 5G. Professional Standards Requirements PAGEREF _Toc14760290 \h 5H. Sensitive to Diverse Populations PAGEREF _Toc14760291 \h 5I. Reliable and Valid Individual Test Scores PAGEREF _Toc14760292 \h 5J. Discussion of Norms Sample PAGEREF _Toc14760293 \h 6K. Inferences Regarding Accommodated Testing PAGEREF _Toc14760294 \h 6L. Standard Setting PAGEREF _Toc14760295 \h 6M. Coordination and Collaboration PAGEREF _Toc14760296 \h 6N. Per Test Taker Cost Estimate PAGEREF _Toc14760297 \h 7O. Required Forms PAGEREF _Toc14760298 \h 85. Rules Applicable to All Respondents PAGEREF _Toc14760299 \h 96.Eligibility Requirements PAGEREF _Toc14760300 \h 97.Application Timeline PAGEREF _Toc14760301 \h 108.Questions and Answers PAGEREF _Toc14760302 \h 109. Application Submission Process PAGEREF _Toc14760303 \h 1110. Application Review PAGEREF _Toc14760304 \h 1311. Determination of Award and Award Process PAGEREF _Toc14760305 \h 1412. Appeal Process PAGEREF _Toc14760306 \h 14Appendix A. Application Checklist PAGEREF _Toc14760310 \h 16Appendix B. Application Evaluation Score Sheet PAGEREF _Toc14760311 \h 17Request for Applications for Tests Designed to Measure the Basic Skills Taught in California Public High Schools for Possible Use as the California High School Proficiency ExaminationPurposeSeeking Available Test for LicensingThis Request for Applications (RFA) is seeking applications from test publishers (hereto referenced as Respondents) of tests designed to measure competency in the basic skills taught in California public high schools. The proposed tests must be commercially available, nationally normed tests that measure achievement of the Common Core State Standards (CCSS). The successful Respondent’s test will be considered for possible selection as California’s high school proficiency test, known as the California High School Proficiency Examination (CHSPE). It is anticipated the selected test(s) will be used for the CHSPE program for up to five years, beginning on July 1, 2020, contingent on contractual negotiations. Future administrations may be approved by the California Department of Education (CDE) and negotiated with the Respondent. The CDE may exercise its discretion to approve one applicant’s test or reject all applicants’ tests. The successful Respondent must be willing to enter into the CDE’s CHSPE administration contract with the Sacramento County Office of Education (SCOE) as a subcontractor—a partnership consistent with the previous test publisher and SCOE for the past 9 years.BackgroundProgramState law requires the CDE to develop standards of proficiency in basic skills taught in public high schools and to provide for the administration of examinations prepared by or with the approval of the CDE to verify proficiency. To verify proficiency, the test used for the CHSPE must be designed so the cut score a test taker attains can be shown to be equal to the standard of performance of a high school graduate who is college and career ready.Eligible test takers currently include (1) any person sixteen years of age or older; (2) any person who was enrolled in grade ten for one academic year or longer; or (3) any person who will complete one academic year of enrollment in grade ten during the CHSPE regular administration (spring or fall). While most CHSPE test takers are enrolled in school when taking the test, current school enrollment is not a requirement to take the CHSPE. Designed for test takers seeking an early start to college or career opportunities, the CHSPE establishes a means for exemption from further compulsory high school attendance. Successful test takers are provided with a certificate of proficiency equivalent to a California high school diploma. The CDE is required to provide an administration of the CHSPE once in the fall and once in the spring of every academic year and, at the discretion of the State Superintendent of Public Instruction, approve a summer administration. For purposes of this RFA, the CHSPE will be administered once in the fall, once in the spring, and once in the summer of each academic year of the contract. To maintain test security, the CHSPE is administered only at CDE-approved CHSPE testing sites. SCOE is responsible for seeking CDE approval of testing sites.Applicable laws and regulations for the CHSPE are cited in Section 3 of this RFA.Funding StructureThe costs of the administration of the CHSPE are fully funded through the collection of testing fees from individual test takers. State law authorizes the CDE to charge a fee to each test taker in an amount sufficient to recover the costs of administering the CHSPE, including the cost of test renewal. One exception is that state law prohibits the CDE from charging a fee to an eligible, certified homeless youth or foster youth. State law further stipulates that the CHSPE vendor(s) must agree to absorb the cost of these fees. As a result of this exception, the loss of fees pursuant to the homeless and foster youth fee waivers shall be deemed to be a cost of administering the CHSPE when setting an overall fee. All fees collected are deposited in the state treasury to be used to cover test administration costs, including costs paid to SCOE and its subcontractors. The annual cap for total fees collected (+) and total fees reimbursed to the contractor (-) for the CHSPE program is set at $1.244 million annually. The Department of Finance (DOF) may adjust the reimbursement cap to reflect changes in actual reimbursements from the contractor for the CHSPE. However, any fees collected in excess of actual costs of the administration of the CHSPE shall be transferred to the General Fund by order of the Director of Finance. Citation of Applicable Laws and RegulationsThe California Legislative Information website at displays the relevant California Education Code sections 48410(e), 48412, and 48414 that pertain to the CHSPE program.Regulations pertinent to the CHSPE can be found at (California Code of Regulations, Title 5, Division 1, Chapter 11, Subchapter 8, sections 11520–11523).Application ContentsEach application must include and address an existing, commercially available, nationally normed test that measures achievement of the California CCSS. The Respondent must specify in its application the appropriateness of the test for assessing test taker performance in the content standards specified by the California CCSS for mathematics and English Language Arts (ELA) taught in California public high schools. A. Cover SheetThe application must include a completed signed Application Cover Sheet form (Attachment 1) certifying that, if selected, the Respondent is willing to:Enter into the CDE’s CHSPE administration contract as a subcontractor of SCOE. License the test for administration by the CDE under the name of the CHSPE.Supply all necessary test materials and scoring keys to SCOE and its subcontractors to administer and score the test.Fully support its product for no less than five years without revision. Annual versions of the test, due to placement of field test items, are not “revisions” for the purposes of this RFA.B. Test InformationThe application must provide the following information about the proposed test.Title of the test battery (series)Acronym or initialism used for test titleEdition or versionCopyright yearTest publisher nameAvailability in the required paper-based test formatNote: The CDE reserves the right to decide to transition to a computer-based format of the selected test at a later date during the five-year term, if one is or becomes available. Prior to the CDE granting approval for use, the CDE will require the Respondent to conduct a pilot, at the Respondent’s own cost, of the computer-based format at CDE-approved testing centers (that opt to participate) in order for the CDE to verify the feasibility of use in future years. If the computer-based format is then approved for use by the CDE, both the paper-based and computer-based formats will be made available beginning in the third year in which the successful test is used for the CHSPE. The Respondent is not to include costs to conduct a possible computer-based format pilot in its per-test-taker costs for the paper-based format in Section N.Availability of required content areas assessing California CCSS. It tests, at a minimum, the following subjects: (a) English language arts (ELA)—reading and writing (including a writing task requiring the test taker to write an expository essay); and (b) mathematics.Availability of one or more writing tasks (essays)Availability of at least three secure parallel forms of the testAvailability of refreshment items as neededAvailability of large-print formsAvailability of braille formsAvailability of practice testsAvailability of sample itemsC. Testing Time by Content AreaThe application must include a table that shows, by content area, the number of test questions; the average testing time, in minutes; and the number of minutes required to provide instructional directions. D. Test Primary Purposes and UsesThe application must include a discussion of the primary purposes and uses of the test and a description of how the test scores are to be interpreted and used. The application must describe the Respondent’s experience in the successful conduct of testing programs adopted and administered by states. E. Equating MethodologyThe application must present the methodology that was used to develop and equate the parallel forms of the norm-referenced test (NRT) and any cautions about the comparability of results that may be obtained by using the parallel forms. If any of the NRT has been distributed in California, include a list of schools and/or districts in California that may have received or purchased the NRT. The application must address the year the test was normed in relation to the implementation of the California CCSS in classroom instruction.F. Alignment with the California Common Core State Standards The application must include a summary table presenting the percentage of ELA and mathematics California CCSS addressed by the high school test(s). The application also must describe the method used to produce the summary table. The application also must include the year the alignment study was completed. The CCSS for ELA and mathematics taught in California high schools are available on the CDE California CCSS web page at . Professional Standards RequirementsThe Respondent must include evidence that the test battery selected was developed in accordance with all applicable standards for test construction found in the Standards for Educational and Psychological Testing (SEPT) (Washington, DC: American Educational Research Association, 2014). The application must demonstrate how the tests meet the criteria for test development, administration, and test use described in the SEPT.The Respondent must submit copies of the technical manual for the test with a guide to the manual that presents the page numbers, tables, charts, and narrative that provide evidence that the test was developed in accordance with the SEPT. H. Sensitive to Diverse PopulationsThe application must demonstrate that the tests are written to minimize any real or perceived bias or language that might be construed to be insensitive to California’s diverse population. The tests must, whenever possible, use universal design principles to ensure access for the greatest number of test takers and for participation and reporting of results for test takers with individualized education programs (IEPs) or Section 504 plans.I. Reliable and Valid Individual Test ScoresThe application must include a description of the technical characteristics of the test scores based on the technical manual for the test, including the ability of the Respondent to produce valid and reliable individual test taker scores in a timely manner. State law requires notification of CHSPE examinees and the schools they attend, if any, of the test results no later than two weeks before the date on which that semester ends in a majority of school districts that maintain high schools.The application must address measurement error, equating errors, and any other quantifiable random or systematic influences on test scores to determine whether, across the NRT testing series, the error is acceptable. Standard errors, as well as reliability coefficients, must be reported.J. Discussion of Norms SampleThe application must include a description of the nature of the national norms as they relate to characteristics of the norms sample, quality and age of the empirical data, accuracy of data for subgroups, and the calendar window during which the testing occurred for the norms sample. Reports of the norms studies must include precise specifications of the population sample, the sampling procedures, and participation rates at individual and school levels. Reports of standard setting, if conducted, must be described with regard to the procedures used and the resulting cut point(s). K. Inferences Regarding Accommodated TestingThe application must present any empirical data from the norms sample and/or special studies conducted to show whether resources (e.g., accommodations, etc.) are required for special-needs test takers and whether these variations affect the inferences that can be made from the scores received.L. Standard SettingThe application must clearly describe the standard setting process used by the Respondent to establish a performance standard (cut point) for the proposed test shown to be equal to the standard of performance of a California high school graduate who is college and career ready. The application must include information on the date(s) the standard setting occurred, the participants of the standard setting, and the evaluation process used by the participants and an analysis of the recommended performance standard for reasonableness, consistency, and other characteristics. The application must clearly identify the passing score in each content area recommended for use by the Respondent to meet the requirements of the CHSPE and this RFA.M. Coordination and CollaborationThe Respondent must be willing to provide support for the test for no less than five years. The application must specify, in detail, how the Respondent will, at a minimum, coordinate with the CHSPE contractor to implement and support the use of the test, if selected, as well as be available to participate in meetings between the CHSPE contractor and the CDE, as needed at the request of the CDE, regarding status of the use of the selected test. The meetings may be held in person at the CDE headquarters located in Sacramento, California, or may be conducted via teleconference at the CDE’s request. N. Per Test Taker Cost EstimatesThe Respondent must identify the per-test-taker cost estimates for the costs of licensing the proposed paper-based test format and all applicable scoring keys and other tools necessary to produce and report test results, as well as the costs for completing the required coordination and collaboration activities outlined in Section 4.M of this RFA. Using the proposed per-test-taker cost estimates as a guide from both the successful Respondent(s) and the CHSPE administration contractor, the SCOE, the CDE will determine and approve the final registration fee, late registration fee, and any applicable records processing fees to be charged to test takers.When formulating their per-test-taker cost estimate, Respondents must use the number of test administrations, the estimated number of test registrants, and the number of homeless and foster youths requesting test registration fee waivers per academic year provided in tables 1 and 2, below, and table 3, on the following page.Table 1. Number of CHSPE Test Administrations per Academic YearAcademic YearTest Administrations Per Academic Year2020–21: July 2020 to June 2021Fall 2020, spring 2021, and summer 20212021–22: July 2021 to June 2022Fall 2021, spring 2022, and summer 20222022–23: July 2022 to June 2023Fall 2022, spring 2023, and summer 20232023–24: July 2023 to June 2024Fall 2023, spring 2024, and summer 20242024–25: July 2024 to June 2025Fall 2024, spring 2025, and summer 2025Table 2. Estimates for Annual CHSPE Test ExamineesAdministrationNumber of ExamineesSpring 3500Fall3000Summer3000Table 3. Annual Number of Homeless Youth and Foster Youth Test TakersAcademic YearHomeless YouthsFoster Youths2017–1838192018–193324The Application must specify a per-test-taker cost estimate for each of the following:The licensing of the paper-based test format to the CDESupplying all necessary test materials and scoring keys to the CHSPE contractor to administer and score the testCoordinating with the CHSPE contractor and the CDEA total test taker cost estimate (total of cost estimates provided in 1, 2 and 3, above)O. Required FormsEach application must include an Application Cover Sheet (Attachment 1) per Section 4.A of this RFA.Respondents that have not done business previously with the CDE will need to complete and return the STD-204 Payee Data Record form with their applications. The form is located at AttachmentsThe following two attachments are required by the successful Respondent upon selection as a subcontractor to the CHSPE administration contractor and do not need to be included with the application. However, Respondents are required to certify that the two forms below will be completed and signed in accordance with the instructions indicated below:Conflict of Interest and Confidentiality Statement (Attachment 2), which must be completed, signed, and dated by the CHSPE administration contractor and all its subcontractors (the successful Respondent) as a condition of receipt of the contractB. California Department of Education Computer Security Policy (Attachment 3), which must be completed, signed, and dated by the CHSPE administration contractor, subcontractors, and each of their employees engaging in services to the CDE related to this RFA and the resulting contract 5. Rules Applicable to All RespondentsPrior to submitting the application, Respondents are strongly encouraged to read the entire RFA and consider all requirements for eligibility. By responding to this RFA, Respondents agree to the following:The CDE will not reimburse Respondents for any costs associated with responding to this RFA or for travel expenses incurred to travel to Sacramento to meet with CDE staff. The costs of preparing and delivering the application are the sole responsibility of the Respondent. Submitting a response to this RFA in no way obligates the CDE to enter into any contractual relationship with any of the Respondents.If this RFA results in a future agreement or contract with the CDE, the selected Respondent must be willing to agree to the State’s General Terms and Conditions (GTC 610) and the Contractor Certification Clauses (CCC-307) set forth at and to sign the CDE Conflict of Interest and Confidentiality Statement and Computer Security Policy in addition to other terms and conditions negotiated between the CDE and the Respondent. Respondents must be willing to meet with CDE staff at 1430 N Street, Sacramento, CA to give a presentation concerning their response to this RFA and to answer any questions that may be posed by the CDE. All documents submitted in response to this RFA will become the physical property of the CDE and may be provided to members of the public. Respondents should consult with their own legal counsel as necessary to protect any patent disclosed or any trademark or copyright contained in the response.Approval of a specific high school proficiency test from a Respondent is subject to the sole discretion of the CDE. The CDE reserves the right to not approve any high school proficiency test. Eligibility RequirementsThe Respondent must be legally constituted and qualified to do business in the State of California. If required by law, any business entity requiring registration with the California Secretary of State must submit a current Certificate of Good Standing issued by the California Secretary of State. The required document can be obtained through the Certification Unit at 916-657-5251 or through the website at . Sole proprietorships, partnerships, public or private agencies, unincorporated organizations, or associations may submit responses to this RFA.Note: Respondents should allow sufficient time to obtain the certificate from the California Secretary of State. If the Respondent’s legal status does not require a filing or registration with the California Secretary of State, a separate paragraph must be provided in the response, clearly stating the Respondent’s legal status and evidence that it is legally constituted and qualified to do business with the State of California. With the exception of organizations whose legal status precludes incorporation (i.e., public agencies, sole proprietorships, partnerships), Respondents that are not fully incorporated by the deadline for submitting applications will be disqualified.Application Time LineTable 4, below, includes dates for critical events related to this RFA.Table 4. Application Time LineCritical EventDate(s)RFA release date.October 1, 2019Letter (email) of Intent due to the CDE.October 14, 2019Respondent questions are due to the CDE.October 14, 2019Answers to Respondent questions posted by the CDE.November 1, 2019Application due to the CDE.December 10, 2019The CDE conducts the Application review process using the criteria specified in the RFA.December 11, 2019 through February 14, 2020The CDE begins drafting the contract scope of work for the CHSPE administration contract with SCOE to include the test of the selected Respondent.March 13, 2020The CDE makes its recommendation for the selected test(s) to the SBE at the May 2020 SBE meeting.May 6 and 7Estimated Contract Start Date contingent on approval by the Department of General Services.July 1, 2020Questions and AnswersAll RFA questions and correspondence should be submitted by email to the Assessment Development and Administration Division, Fiscal Support Office at ADADFiscalSupport@cde., with “CHSPE Test Selection RFA Question” as the email subject line.All RFA questions should be submitted by 4 p.m. on October 14, 2019. Respondents are strongly encouraged to read this entire RFA prior to submitting questions.The CDE’s answers to questions—submitted by the deadline—will be posted no later than 4 p.m. on November 1, 2019. All Respondents that submit a letter of intent, per Section 9.A. of this RFA, no later than 4 p.m. on October 14, 2019, will be notified and provided with a link to the questions and answers by email when the answers have been posted. Application Submission Process A. Notice of Intent to ApplyRespondents are not required but are encouraged to submit a letter of the intent to apply to ADADFiscalSupport@cde. by November 15, 2019, in order to be added to an email list for the purposes of receiving answers to application questions, clarifications, or updates.The letter of intent should include the name of the proposed test and the name and email address of a contact person for the lead official Respondent.B. Format of the Application NarrativeApplications that do not comply with the formatting requirements below will not be reviewed or considered for acceptance, and the contacts listed on the Application Cover Sheet will be notified in writing.The application must include a completed, signed Application Cover Sheet form (Attachment 1).The application narrative must use 12-point type, in an easy-to-read font, such as Arial or Times New Roman.Respondents are required to attach additional information, such as appendices, to the application. Appendices must be labeled. Any additional information submitted as appendices must be referenced in the descriptive text of the appropriate application section and can include information illustrating previous experience or expertise, scientifically based research, assessment data, or a list of references or resources used in developing the application.The application must include all properly labeled sections of the application described below, including: A. Cover SheetB. Test InformationC. Testing Time by Content AreaD. Test Primary Purpose and UsesE. Equating MethodologyF. Alignment with the California CCSSG. Professional Standards RequirementsH. Sensitive to Diverse PopulationsI. Reliable and Valid Individual Test ScoresJ. Discussion of Norms SampleK. Inferences Regarding Accommodated TestingL. Standard SettingM. Coordination and CollaborationN. Per-Test-Taker Cost EstimatesO. Required FormsC. Application Submission RequirementsThe following steps outline the application submission requirements:The application will consist of two components:Application narrativeTest and test materials Respondents must submit one signed original, six paper copies, and one electronic PDF copy of the application narrative on a flash drive. The flash drive must contain all narrative sections, forms, and attachments.Separate from the application, respondents must send six copies of the test and materials being submitted for consideration. Note: Respondents are not to transmit copies of a computer-based test format or materials in any manner. The successful Respondent may be contacted by the CDE regarding any computer-based format of the selected test during contract negotiations.Respondents are urged to use express, certified, or registered mail. Transmission by email or fax will not be accepted. The complete application and copies of the test, including all required components, must be received by the CDE Assessment Development and Administration Division by 4 p.m. on December 10, 2019. Address the package as follows:CHSPE Test Selection ApplicationAssessment Development and Administration DivisionCalifornia Department of Education1430 N Street, Suite 4409Sacramento, CA 95814-5901If changes to the Respondent’s application need to be made, the Respondent must resubmit the entire application prior to the submission deadline. The last submitted application will be the one considered for review. Late or incorrectly formatted applications will not be reviewed or scored.An application may be rejected if it is incomplete or if it contains any alterations of form or other irregularities of any kind. The CDE may reject an application that is not responsive, does not meet the technical standards, or is not from a designated Respondent or may choose to reject all applications. The CDE also may waive any immaterial deviations in an application. The CDE’s waiver of immaterial defect shall in no way modify the RFA document or excuse the Respondent from full compliance with all requirements of this RFA.10. Application ReviewFormal RequirementsEach application will be checked for the presence or absence of required information in conformance with the application requirements of this RFA. Applications that do not provide requested information will be rejected as nonresponsive.Applications that contain false or misleading statements and/or provide references that do not support an attribute or condition claimed by the Respondent shall be rejected.The CDE will evaluate each application to determine its responsiveness to the CDE’s needs. Applications and oral interviews (if applicable) will be rated by an evaluation panel using a consensus process for determining final scores as noted below.Technical EvaluationPhase I: Pre-Evaluation Review—Application ChecklistThe CDE will review the contents of the Application Checklist (Appendix A) for the presence of all correctly completed required forms/attachments. Respondents will be rated on the basis of Pass/Fail. Applications that do not provide all of the forms/attachments, correctly completed as required by the RFA, will be deemed as nonresponsive, and the Respondent will receive a Fail for this portion of the evaluation process, which will result in the elimination of the Respondent’s test from further consideration. 2.Phase II: Application Evaluation CriteriaEach eligible application will be read, reviewed, and evaluated by a panel of reviewers selected for their experience and expertise. The evaluation panel will evaluate those applications that meet the application requirements. The evaluation will be based on the criteria shown in Appendix B. After the appeal process is closed, the CDE will post a notification of accepted awards on the CHSPE Test Selection web page, located at . Determination of Award and Award ProcessUsing the technical review scores of each application and test, the CDE will select a test for use for the CHSPE program. The CDE may exercise its discretion to reject all applicant tests, to approve one applicant’s test, or to approve multiple applicant tests from several Respondents. 12. Appeal ProcessThe appeal process includes the following items:The Respondent has seven business days from the day the application award announcement is made to appeal the results of this competitive award. The appeal must be in written form, clearly stating the basis for the appeal. Appeals must be sent via email and US mail to:Michelle Center, DirectorAssessment Development and Administration DivisionCalifornia Department of Education1430 N Street, Suite 4409Sacramento, CA 95814email: ADADFiscalSupport@cde.The application review process and appeal process will be based on written record alone. No hearings will be allowed. The appeal should be based on the failure of the CDE to correctly apply standards for reviewing the requirements or evaluating the applications as specified in the RFA. The appeal should demonstrate procedural error, inconsistency, or substantive failure to accurately score an application based on the facts or a statement in the application.A Respondent may not use the appeal process to present new information to enhance its application or correct the application.A committee will evaluate the appeal and reevaluate the application and review process as necessary to make the final decision. The person submitting the appeal will be notified of the decision in writing within three weeks from the date that appeals are due to the CDE. That decision shall be the final administrative action afforded the appeal.Appendix A. Application ChecklistContent RequestedProvided (Yes/No)A. Cover SheetYes/NoB.1. Title of the test battery (series)Yes/NoB.2. Acronym or initialism used for test titleYes/NoB.3. Edition or versionYes/NoB.4. Copyright yearYes/NoB.5. Test publisher nameYes/NoB.6. Availability in the required paper-based test formatYes/NoB.7. Availability of required content areas assessing California Common Core State Standards (CCSS)Yes/NoB.8. Availability of one or more writing tasks (essays)Yes/NoB.9. Availability of at least three secure parallel forms of the testYes/NoB.10. Availability of refreshment items as neededYes/NoB.11. Availability of large-print formsYes/NoB.12. Availability of braille formsYes/NoB.13. Availability of practice testsYes/NoB.14. Availability of sample itemsYes/NoC. Testing time by content areaYes/NoD. Test primary purpose and usesYes/NoE. Equating methodologyYes/NoF. Alignment with the California CCSSYes/NoG. Professional standards requirementsYes/NoH. Sensitive to diverse populationsYes/NoI. Reliable and valid individual test scoresYes/NoJ. Discussion of norms sampleYes/NoK. Inferences Regarding accommodated testingYes/NoL. Standard settingYes/NoM. Coordination and collaborationYes/NoN. Per-test-taker cost estimatesYes/NoO.1. Conflict of Interest and Confidentiality StatementYes/NoO.2. California Department of Education Computer Security PolicyYes/NoAppendix B. Application Evaluation Score SheetRFA ContentCriteriaPoints PossibleA. Cover SheetThe Respondent provided a complete and signed cover page certifying that, if selected, it is willing to (a) enter into the California Department of Education’s (CDE’s) California High School Proficiency Examination (CHSPE) administration contract with the Sacramento County Office of Education (SCOE) as a subcontractor; (b) license the test for administration by the CDE under the name of the CHSPE; and (c) fully support its product for no less than five years without revision.5C. Testing time by content areaThe table provided in the application shows, by content area, the number of test questions, the average testing time in minutes, and the number of minutes required to provide instructional directions.5D. Test primary purposes and usesThe application includes a discussion of the primary purposes and uses of the test series and a description of how the test scores are to be interpreted and used. The application describes the Respondent’s experience in the successful conduct of testing programs adopted and administered by states.5E. Equating methodology The application presents the methodology that was used to develop and equate the parallel forms of the norm-referenced test (NRT) and provides any cautions about comparability of results that may be obtained by using the parallel forms. The application indicates whether any of the NRT has been distributed in California and, if so, includes a list of schools and/or districts in California that may have received or purchased the NRT. Inaccurate or inappropriate methodologies will result in a 0/10 score.10F. Alignment with the California Common Core State Standards (CCSS)The application includes a summary table presenting the percentage of English Language Arts and mathematics California CCSS addressed by the high schools test(s). The summary also describes the method used to produce the summary table described above. 15G.1. Professional standards requirements—in accordance with the Standards for Educational and Psychological Testing (SEPT)The application includes evidence that the test battery selected was developed in accordance with all applicable standards for test construction in the SEPT (Washington, DC: American Educational Research Association, 2014). 10G.2. Professional standards requirements—technical manualThe application includes copies of the technical manual. The application also provides a guide to the technical manual that presents the page numbers, tables, charts, and narrative that provide evidence that the test was developed in accordance with the SEPT. 15H. Sensitive to diverse populationsThe application demonstrates that the tests are written to minimize any real or perceived bias or language that might be construed to be sensitive to California’s diverse population. The application demonstrates that the tests use universal design principles to ensure access for the greatest number of test takers and for participation and reporting of results for test takers with individualized education programs or Section 504 plans.10I. Reliable and valid individual test scoresThe application includes a description of the technical characteristics and the ability of the Respondent to produce valid and reliable individual test taker scores in a timely manner.15J. Discussion of norms sampleThe application includes a description of the nature of the national norms as they relate to characteristics of the norms sample, quality and age of the empirical data, accuracy of data for subgroups, and the window during which testing should occur. The application includes reports of the norms studies that include precise specifications of the population sample, the sampling procedures, and participation rates at the individual and school levels. 15K. Inferences regarding accommodated testingThe application presents empirical data from the norms sample and/or special studies conducted to show whether resources are required for special-needs test takers and whether these variations affect the inferences that can be made from the scores received.15L. Standard settingThe application includes reports of the standard setting conducted that describe procedures used and the resulting cut point(s). 15M. Coordination and collaborationThe application specifies, in detail, how the Respondent will coordinate with the CHSPE contractor to implement the use of the test and be available to participate in meetings between the CHSPE contractor and the CDE as needed.15Total Points Possible: 150 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download