NYC Department of Education (PDF)

U411C110284

NYC Department of Education InnovateNYC: An Innovation Ecosystem for Urban School Districts

0284

i3 Project Narrative

Project Narrative: Table of Contents

Absolute and Competitive Preference Priorities Narrative ...................................................... 2

Need for Project and Quality of Project Design......................................................................... 3 An exceptional approach to an unmet need ................................................................................ 3 Goals, objectives, and strategy.................................................................................................... 8

Strength of Research, Significance of Effect, and Magnitude of Effect................................. 11 Research-Based Findings or Reasonable Hypotheses that Support the Proposed Project ........ 11 The Proposed Project Has Been Attempted Previously, with Promising Results..................... 12 Improving Student Achievement or Student Growth................................................................ 14

Quality of Project Evaluation .................................................................................................... 15 Methods of Evaluation Are Appropriate to the Size and Scope of Project............................... 16 Methods of Evaluation Will Provide High-Quality Implementation Data and Performance Feedback, and Permit Periodic Assessment of Progress........................................................... 23 Evaluation Will Provide Sufficient Information to Facilitate Further Development, Replication, or Testing in Other Settings .................................................................................. 24 Project Plan Includes Sufficient Resources to Carry Out Project Evaluation Effectively ........ 24

Strategy and Capacity to Further Develop and Bring to Scale .............................................. 25 Number of Students to be Reached by the Proposed Project .................................................... 25 Capacity of Applicant & Partners to Develop Program & Bring to Scale ................................ 25 The Feasibility of Successful Replication in a Variety of Settings........................................... 27 Cost of Project, Cost Per Student, and Cost to Reach More Students ...................................... 28 Plan for Dissemination and Further Development or Replication ............................................ 29

Sustainability ............................................................................................................................... 30 Resources and Support to Operate Beyond the Length of the Grant ........................................ 30 Incorporation of Project into Ongoing Work of Applicant and Partners .................................. 31

Quality of the Management Plan and Personnel ..................................................................... 31 Clearly defined responsibilities, timelines, and milestones ...................................................... 31 Qualifications of Key Project Personnel ................................................................................... 34

1|Page

U411C110284

0284

NYC Department of Education InnovateNYC: An Innovation Ecosystem for Urban School Districts

i3 Project Narrative

Absolute and Competitive Preference Priorities Narrative

New York City Department of Education (NYCDOE) is submitting a development grant proposal to develop and evaluate its InnovateNYC Innovation Ecosystem, a network of schools, instructional designers, and investors who collaborate to develop more effective learning solutions that will help students overcome the specific learning challenges that inhibit their success in science, technology, engineering, and mathematics (STEM) courses. The ecosystem works by improving the exchange of information between schools, which understand students` needs, and those who design and fund the development of innovative new learning solutions to meet those needs. Assessment specialists work with InnovateNYC schools to identify the critical misconceptions and skill deficits inhibiting student achievement in STEM courses. InnovateNYC publishes those prioritized needs via crowdsourcing technologies to a growing community of learning scientists, instructional designers, product developers, and early-stage funders, who partner with schools to develop innovative instructional resources and products targeted to the published needs. InnovateNYC selects the most promising proposals and evaluates their efficacy by piloting them in schools using a rigorous experimental design research protocol. Effective solutions are purchased for large-scale implementation across the NYC school system. By creating a coordinated ecosystem of partners whose interests, needs, and resources are aligned, InnovateNYC will significantly improve both the number and the efficacy of innovative STEM instructional resources targeted to empirically defined learning needs.

This proposal seeks funding for the establishment of a small team to manage the ecosystem, seed funding to incentivize early stage innovations, and support for the evaluation of innovation pilots. The first phase of the initiative will target 10,000 high needs students in grades

2|Page

U411C110284

0284

NYC Department of Education InnovateNYC: An Innovation Ecosystem for Urban School Districts

i3 Project Narrative

5-12 (African America, Hispanic, English language learners, students with special education

needs, women) with demonstrated potential for advanced STEM study (See Appendix A and H).

NYCDOE will address absolute priority 2 and competitive preference priorities 7 and 10:

By defining a set of learning challenges that prevent students from enrolling and

excelling in STEM coursework, we expect to more effectively inform the development of

targeted solutions in the market and increase the pipeline of innovations with the greatest

capacity to enable middle and high school students to prepare for, enter, and graduate college

with STEM-related degrees. (Competitive Priority 7)

By translating high impact STEM learning challenges into a set of prioritized solutions

requirements, in such a way that sparks innovative solution designs, we expect to

increase the supply and demand for high impact learning technologies, instructional modules,

and professional development supports that significantly improve student achievement in

STEM coursework. (Competitive Priority 10)

By crowdsourcing, piloting, evaluating, and communicating outcomes of the most

promising solutions to high impact STEM learning challenges, we expect to more

effectively meet the unique needs of the 1.1 million students in the largest school district in

the country. (Absolute Priority 2)

Need for Project and Quality of Project Design

An exceptional approach to an unmet need The Need: It is a nationally recognized problem that traditionally underrepresented

student groups (e.g. women, minorities, English language learners, those with special education needs) are characterized by a low level of participation and success in STEM classes. It is also

3|Page

U411C110284

0284

NYC Department of Education InnovateNYC: An Innovation Ecosystem for Urban School Districts

i3 Project Narrative

known that this low participation and performance can negatively affect the opportunities and

choices available to students in those groups, significantly decreasing their long-term academic

and career opportunities. Inequitable participation and achievement are less visible in early years,

but steadily grow year over year. Perhaps most notably, differences in the National Assessment

of Educational Progress (NAEP) math scores between boys and girls nearly double between the ages of 9 and 17.i To address these inequities in STEM participation and achievement, it is

critical that we intervene in upper elementary and middle school, when the foundations for later

participation and achievement inequities are being laid.

Of the 68,000 engineering bachelor`s degrees awarded in the United States in 2006, only

12.5% were earned by underrepresented minorities, who represent nearly 30% of the overall

undergraduate student population. Even more inequitable were doctoral degrees in engineering:

only 3% of degrees awarded were to black, Latino, and Native American students, and 1.5% to

women. While there are 1.5 million engineers employed in the United States, only 9.5% are

women. Women received fewer than 35% of science, technology, engineering, and mathematics degrees awarded in 2008. ii

Clearly the low representation of these groups in STEM-related careers is tied to low

participation and performance in STEM-related coursework in K-12 and college. And while

there are numerous cultural factors related to low participation in STEM courses among these

student populations, we believe these statistics are due in part to the lack of systematic applied

research into how these student populations could be engaged into STEM fields through more

diverse instructional approaches employing innovative new learning modalities, including those

that draw on games theory to increase student motivation and engagement, those that incorporate

4|Page

U411C110284

0284

NYC Department of Education InnovateNYC: An Innovation Ecosystem for Urban School Districts

i3 Project Narrative

immersive simulations and real-world problem solving to increase authenticity of tasks, and

those that reflect the social nature of cognition and problem solving employed by practicing

scientists, mathematicians, engineers, and technologists in the field. The most talented educators

will continue to struggle to improve the engagement and performance of these student groups if

they are not provided the tools that address the highest impact learning challenges. Developers

cannot truly meet the needs of these student groups if they have no clarity around the highest

impact learning challenges, the needs of schools, and are able to finance innovation. All students,

but particularly those in these high needs group, will continue to struggle with STEM

coursework and employers will continue to find it challenging to find talented students for

STEM-related work for as long as this gap in understanding persists between those on the

demand side and those on the supply side.

The proposed initiative, the InnovateNYC Innovation Ecosystem, is designed to better

align the innovative solutions in the market (both existing and yet developed) with the most

critical student learning challenges--those challenges that, if overcome, would unlock the

potential for these students to excel in STEM coursework and careers. We believe that we can

leverage the size and diversity of our district, as well as the resources and natural motivations of

various partners, to direct the market to invest in more targeted, innovative learning solutions by

better articulating student and educator need, providing clear metrics for how potential solutions

will be evaluated, and recruiting partner schools willing to co-design and pilot promising

solutions. We can influence the market to invest in these targeted solutions by committing to

large-scale purchases of proven solutions and a sizable market to establish a presence. We would

5|Page

U411C110284

0284

NYC Department of Education InnovateNYC: An Innovation Ecosystem for Urban School Districts

i3 Project Narrative

also partner with philanthropic and private equity capital to help develop, evaluate, and scale the

most promising innovations. (See Appendix C)

The Approach: While these students can be placed in a single category, they are surely

not all the same. It follows that their challenges and the solutions to those challenges are

different. Therefore, we have designed the InnovateNYC ecosystem to increase the pipeline of

innovations that can meet those varying needs. We will approach the development of this

innovation pipeline in two stages--early stage prototyping and large scale efficacy piloting. We

will seed, prototype, and pilot up to 60 early stage innovations in classrooms each semester over

three years (stage 1). Of the 60 early stage innovations, a subset will meet our efficacy and

feasibility standards and be piloted at a larger scale using random assignment to pilot schools

(stage 2). Developers will be required to fund development costs to get solutions pilot ready, as

well as their pilot implementation costs. The InnovateNYC team will use a portion of i3 grant

funds to seed early stage innovations and match those developers who show greatest stage 1 pilot

results with foundations and private equity investors to support stage 2 piloting and expansion.

Creating an innovation ecosystem requires investing in a few specific components:

1. Methodologies for defining and prioritizing critical learning challenges. NYCDOE will

use and adapt a methodology developed by the College Board to identify the fundamental

learning challenges that are hindering students from successfully completing advanced courses in

science and math. The methodology combines item-level assessment data analysis with

professional judgment about learning progressions and teacher professional development to

identify the most critical, actionable learning challenges that schools should address to raise

student achievement. James Pellegrino, Distinguished Professor at the University of Illinois at

6|Page

U411C110284

0284

NYC Department of Education InnovateNYC: An Innovation Ecosystem for Urban School Districts

i3 Project Narrative

Chicago and head of several National Academy of Science/National Research Council study

committees, will work with a STEM advisory committee to adapt this methodology using New

York City NAEP fourth and eighth grade math and science data. The committee will also

vertically align the learning challenges students face in upper elementary and middle school to

those identified through the AP analyses in high school. This truly ground breaking work will

establish for the first time a set of empirically validated, vertically aligned learning challenges

that our students must overcome beginning in the earliest grades if they are to be successful in

advance STEM courses.

2. A community of STEM subject matter experts, instructional designers, product

developers, and funders who have the capacity and interest to develop innovative new

instructional solutions to address the prioritized learning challenges. We will partner with

incubators like New Schools Venture Fund, STARTL, ImagineK12, Games for Learning

Institute (G4LI), and EdTech Entrepreneurs Lab to continuously scan and recruit edtech

entrepreneurs who are bringing fresh approaches to STEM learning challenges. We will partner

with STEM organizations such as American Association for the Advancement of Science [TBD],

National Science Teachers Association [TBD], the New York Hall of Science, the American

Museum of Natural History, and the College Board to recruit STEM curriculum and subject

matter experts to work with product developers. We will partner with IDEO, a design and

innovation consulting firm, to support the development of quality edtech STEM products by

facilitating design sessions with selected entrepreneurs and NYCDOE schools. And we will

partner with private foundations and venture capital firms to provide seed grants and early stage

investments in promising entrepreneurs.

7|Page

U411C110284

0284

NYC Department of Education InnovateNYC: An Innovation Ecosystem for Urban School Districts

i3 Project Narrative

3. A platform for publishing the learning challenges to the community of solutions

providers, and managing the submission, review, and selection of solutions. Ashoka

Changemakers will provide an in-kind donation, the free use of its information exchange

platform--ChangeShop--and its technical consulting support to manage the publishing of

challenges and crowdsourcing of solutions proposals.

4. A set of schools that have capacity and interest in engaging in a co-design process with

instructional designers and product developers and pilot selected solutions through a rigorous

experimental design to evaluate efficacy. We will recruit schools through the New York City

Innovation Zone--a growing community of 180 forward-thinking schools that are incorporating

technologies and innovative new practices to personalize learning to the needs, motivations, and

strengths of individual students.

5. Evaluation of piloted solutions for impact on student outcomes and return on

investment. We will partner with the Research Alliance for NYC Schools and the Center on

Reinventing Public Education to evaluate selected innovations for impact on student outcomes

and relative return on investment.

Goals, objectives, and strategy The objectives of the InnovateNYC ecosystem are to increase the supply and efficacy of

innovative STEM instructional resources in order to increase the number and diversity of students enrolling and succeeding in STEM courses. We intend to achieve these outcomes by 1) increasing the quality and availability of data on targeted, gateway learning challenges that are hindering student success as defined by their performance on rigorous assessments; 2) increasing

8|Page

 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download