SYSTEMATIC PLAN FOR PROGRAM EVALUATION AND …



SYSTEMATIC PLAN FOR PROGRAM EVALUATION AND ASSESSMENT OF OUTCOMES

Standard VI The program has an identified plan for systematic program evaluation and assessment of educational outcomes.

|CRITERION 18: Written planning for systematic program evaluation and assessment of outcomes includes the following elements: |

|definitions of criteria and required and elective outcomes; |

|defined levels of achievement (decision rules for action); |

|time frames from assessment of all plan components; |

|person(s) responsible for each component of the plan; |

|methods and/or tools to assess each criterion and outcome; |

|reliability, validity, and trustworthiness of methods and tools used; |

|data collected, analyzed, aggregated, and trended; and, |

|verification that findings are used for decision making in program development, maintenance, and revision. |

|Operational Definition |

|Evaluation Plan—document outlining the components of the Nursing Program and including all the NLNAC required elements for evaluation. |

|Expected Outcomes: |

|A written plan is in place that meets the criteria and is used to guide systematic evaluation of the program. |

|Component |Where Documentation|Responsible person |Time/ Frequency of |Assessment method (and |Reliability, Validity, |Report of the |Implementation |

| |is Found | |Assessment |rationale) |Trustworthiness of |data to: | |

| | | | | |Assessment method | | |

| |Assessment |Action |

|Evaluation plan |Nursing Office |Evaluation |Review plan |Evaluation Committee |Evaluation committee |Faculty group |1. Plan did not meet the |1. Plan revised and |

| |“S” drive for all |Committee |bi-annually |review plan for currency |constitute a "panel of | |standard when Self Study |updated to reflect newest |

| |faculty | | |and relevancy and to make |experts" who are | |process initiated. |criteria. |

| | | | |sure it meets standards |qualified to evaluate | | | |

| | | | |listed above. (As plan is|quality of plan. | | | |

| | | | |used it is expected that | | | | |

| | | | |revisions will be needed | | | | |

| | | | |to maintain usefulness of | | | | |

| | | | |document.) | | | | |

|CRITERION 19: Required and elective outcomes as they relate to student academic achievement by program type, are evaluated. |

|Operational Definitions: |

|Definitions for each element are found in the Program Planning and Assessment Document and in the Self Study. |

|Expected Outcomes: |

|Graduates exhibit critical thinking. |

|Students complete required Nursing Process Papers (NPPs) satisfactorily at each level in the Program in order to progress. |

|Graduates show a positive disposition toward critical thinking on the CCTDI. |

|Graduates score above the 50th percentile on the steps of the nursing process as shown on NCLEX RN Program Reports. |

|Graduates rate #2, #3, & #5 on the Graduate Self-Assessment Survey (GSS) as 3.5 or better on a scale of 1-5 upon graduation. |

|Graduates demonstrate communication abilities. |

|100% of students passing are rated as "satisfactory" on communication skills on their clinical evaluation tools each quarter. |

|90% of students passing complete satisfactorily (grade 2.0 or above) a communication project at each level (paper, verbal presentation, etc.) |

|Students rate #7 on the GSS as 3.5 or better on a scale of 1-5 upon graduation. |

|Graduates demonstrate therapeutic nursing intervention skills. |

|Students are rated as satisfactory in all clinical outcomes at each level in the Program in order to progress. |

|Graduates score at or above the 50th percentile for all graduates of all nursing programs in meeting client needs for: safe, effective care environment, health promotion and health maintenance, |

|psychosocial integrity, and physiological integrity as shown in NCLEX RN Program Reports. |

|Students rate #4 on the GSS as 3.5 or better on a scale of 1-5 upon graduation. |

|4. Graduates have the knowledge and skills to pass the NCLEX RN and become licensed RNs. |

|Graduates pass the NCLEX RN at or above the mean rate for the United States. |

|Patterns and rates of employment are tracked. |

|At least 90% of graduates are employed as RN's within six months of graduation. |

|Employment patterns reflect that 80% of those employed are practicing in roles for which they have been prepared (i.e. direct care in hospitals, nursing homes, ambulatory clinics, and home care.) |

|Graduates are satisfied with the preparation the Program has provided for the RN role. |

|Graduating students rate program satisfaction as "3.5" or better on a scale of 1 – 5 upon graduation. |

|Graduate surveys show that 90% of graduates were satisfied with Program preparation. |

|Students accepted into the program are successful in achieving their goals. |

|At least 60% of those admitted to the Nursing Program graduate with an AAAS degree within the standard six quarters (two academic years) 70% within 9 quarters (three academic years.) |

|Component |Where Documentation|Responsible person |Time/ Frequency of |Assessment method (and |Reliability, Validity, |Report of the |Implementation |

| |is Found | |Assessment |rationale) |Trustworthiness of |data to: | |

| | | | | |Assessment method | | |

| |Assessment |Action |

|1. Critical |1. Nursing course |1. Program |1a.b. At the end of|1a. Nursing Process Papers|Interrater reliability |1abcd. Nurs-ing |Greater reliability is |Our Institutional |

|Thinking |summary evaluations|Director, |each quarter: fall,|(NPPs) |is .467 |faculty, Advisory |needed for this to be an |Effectiveness Dept. will |

| | |Evaluation |winter, spring | | |Committee |effective measure |work with us on evaluating|

| | |Committee | | | | |1a. Faculty will continue |after a new rubric is |

| | | | | | | |to evaluate NPPs using |developed. |

| | | | | | | |course criteria as a | |

| | | | | | | |guide. | |

| |1b. Scoring data |Program Director in|Quarterly |1b. California Critical |1b. CCTDI is an |Evaluation |1b. The overall mean score|1b. Continue use |

| |provided by |cooperation with | |Thinking Dispositions |established instrument |Committee |for each disposition is | |

| |Institutional |Institutional | |Inventory (CCTDI) will |that has been | |above 40 (the recommended | |

| |Effectiveness |Effectiveness | |demonstrate a positive |statistically evaluated| |cut score for each scale) | |

| |office |office. | |disposition to critical |for reliability and | |& the overall total mean | |

| | | | |thinking. (Instrument has |validity. | |score is above 280, | |

| | | | |been evaluated for its | | |Students are demonstrating| |

| | | | |ability to measure this | | |that they are disposed | |

| | | | |attribute.) | | |toward critical thinking | |

| | | | | | | |and the Program is | |

| | | | | | | |assisting them to maintain| |

| | | | | | | |this disposition | |

| |1c. NCLEX Program |Program Director |1c. Twice Annually |1c. NCLEX feedback |1c. NCLEX-RN is a valid|Evaluation |1.c. Mean percentile |1c. Continue current |

| |Reports purchased | | |information is purchased |and reliable instrument|Committee |rankings have varied but |curricular plan for |

| |by Program | | |and evaluated for patterns|for measuring entry | |without a specific |teaching nursing process |

| | | | |of change by the |level RN competency. | |pattern. Most have |and monitor. |

| | | | |Evaluation Committee. | | |remained above the 50th | |

| | | | |(Provides a reliable | | |percentile. | |

| | | | |source of information | | | | |

| | | | |about outcomes measured by| | | | |

| | | | |NCLEX.) | | | | |

| |1d. Graduate Self |1d. Program |1d. Quarterly. |The survey matches the |Comparative analysis of|1d. Nursing |1d. Students rate #2, #3, |No action needed. |

| |Assessment Survey |Director |Students are asked |Program Educational |tool and outcomes shows|Faculty, Advisory |& #5 on the GSS 3.5 or | |

| | | |to complete the GSS|Outcomes |consistency. The |Committee |greater. They believe they| |

| | | |just prior to |(Students approaching |Evaluation Committee | |possess critical thinking | |

| | | |graduation. |graduation are most able |constitute a "panel of | |skills. | |

| | | | |to assess their own |experts" who are | | | |

| | | | |abilities with regard to |qualified to evaluate | | | |

| | | | |the components of the |for trends which are | | | |

| | | | |curriculum.) |revealed in the data. | | | |

|2. Interpersonal |2a. Course |2a.b. Program |2abc. At the end of|2ab. Course evaluation |2a.b. Course evaluation|2a. Nursing |2a. 100% of Students who |2a. No change |

|and communication |Evaluation summary |Director, |each quarter: fall,|forms are filled out each |forms are designed to |faculty, |pass are rated | |

|skills |annually |Team Coordinators, |winter, spring |quarter at each level of |collect raw "objective"|Evaluation |satisfactory. All clinical| |

| | |Clinical | |the program to collect |data that is unbiased |Committee, |evaluations include | |

| | |Instructors | |data about success rates |in nature. The |Advisory Committee|communication abilities. | |

| | | | |on student papers, |Evaluation Committee | | | |

| | | | |clinical grades, and |constitute a "panel of | | | |

| | | | |theory grades. (Provides a|experts" who are | | | |

| | | | |way to quickly monitor for|trustworthy to evaluate| | | |

| | | | |trends in internal |for trends in the data.| | | |

| | | | |measures of success within| | | | |

| | | | |the program and at each | | | | |

| | | | |level.) | | | | |

| |2b. Course |See 2a. above |See 2a. above |See 2a. above |See 2a. above |See 2a. above |2b. 90-100% of passing |2b. Continue working with |

| |Evaluation summary | | | | | |students at each level |students to improve |

| |annually | | | | | |have a 2.0 or greater on |writing and interaction |

| | | | | | | |communication project. |skills. |

| |2c. Graduate Self |2c. Program |See 2a. above |2c. See 1d. above |2c.See 1d above |See 2a. above |2c. Graduates for last 3 |2c. Continue working with |

| |Assessment Survey |Director, | | | | |years rated number 7 on |students to improve |

| | |Evaluation | | | | |GSS as 3.5 or above. |communication skills. |

| | |Committee, Advisory| | | | | | |

| | |Committee | | | | | | |

|3. Therapeutic |3a. Syllabi passing|3a. Program |3a. At the end of |3a. See 2a. above |3a.See 2a. above. |3ab. Nursing |3a. All graduates are |No change |

|nursing |requirements and |Director, Team |each quarter: fall,|All clinical evaluation | |Faculty, |satisfactory in clinical | |

|intervention skills|annual course |Coordinator, |winter, spring |tools clearly require | |Evaluation |evaluations | |

| |evaluation summary |Clinical | |satisfactory on all | |Committee, | | |

| | |Instructors | |therapeutic intervention | |Advisory Committee| | |

| | | | |outcomes. | | | | |

| |3b. NCLEX Program |3b. Program |3b. Twice Annually |3b. See 1c. above |3b. See 1c above |3b. Evaluation |3b. In the last 4 years |Continue to monitor .to |

| |Reports |Director, | | | |Committee |only 3 instances of below |determine if trend begins |

| | |Evaluation | | | | |the 50th percentile | |

| | |Committee | | | | |occurred. These were in | |

| | | | | | | |different measures and do | |

| | | | | | | |not constitute a trend | |

| |3c. Graduate Self |3c. Program |3c. At the end of | |3c .See 1d. above |3c. Evaluation |3c. All measures have been|No change |

| |Assessment Survey |Director, |each quarter: fall,|3c. See 1d. above | |Committee, Nursing|above 3.5 for the last 3 | |

| | |Evaluation |winter, spring | | |faculty, Advisory |years. | |

| | |Committee | | | |Committee | | |

|4. Performance on |4a. Nursing |4a. Program |4a. Annually |4a. NCLEX-RN |4a. NCLEX-RN is a |4a. Evaluation |4. Pass rates have |4. Monitor closely. Plan |

|NCLEX-RN |Commission Reports |Director, Nursing | | |valid, reliable, |Committee, Nursing|remained above both state |for diagnostic readiness |

| |on NCLEX RN results|faculty, Evaluation| | |instrument for |Faculty, Advisory |and national or there is |exam to assist graduates |

| | |Committee, Advisory| | |measuring entry level |Committee |some decrease in pass |in studying for exam. |

| | |Committee | | |RN competency. | |rate. | |

|5.Patterns and |5ab. Graduate |5ab. Program |5. a & b. Survey |5. a & b. The survey asks |5. Factual data is |5. Evaluation |5a. All graduates |No change |

|Rates of Employment|Survey |Director, Nursing |sent one year after|for specific factual data |trustworthy. |Committee |responding are employed. | |

| |Advisory committee |Faculty, Evaluation|graduation |regarding employment.. | |Nursing Faculty |Informal data indicates | |

| | |Committee, Advisory|Other--ongoing | | |Advisory Committee|all students desiring | |

| |Communication with |Committee | | | | |employment are employed. | |

| |facility | | | | | |b. All graduates | |

| |administrative | | | | | |responding working in | |

| |personnel | | | | | |roles for which prepared. | |

|6. Graduate |6a. Graduating |6ab. Program |6a .At the end of |6. Graduate survey matches|6. Comparative analysis|Evaluation |6a. Survey shows |6a. & b. Continue |

|satisfaction |Student Self |Director, |each quarter: fall,|the program educational |of tool and outcomes |Committee |satisfaction ranging from |processes in place |

| |Assessment Survey |Evaluation |winter, spring |outcomes. |shows consistency. The |Nursing Faculty, |3.9 to 4.5 on a 5 point | |

| | |Committee |6b. One year after | |Evaluation Committee |Advisory Committee|scale with highest ratings| |

| |b. Graduate surveys| |graduation for each| |constitute a "panel of | |most recent. This meets | |

| |one year after | |class | |experts" who are | |the desired outcome. | |

| |graduation | | | |qualified to evaluate | | | |

| | | | | |for trends which are | |6b. Satisfaction has | |

| | | | | |revealed in the data. | |ranged from 3.9-4.27, | |

| | | | | | | |which meets the desired | |

| | | | | | | |outcome. | |

|7. Graduation/ |7. Nursing Program |7. Program |Quarterly |7. Graduation/ completion |7. The Evaluation |Evaluation |7. The goal of 60% in 6 |7. Continue with supports |

|attrition |Office |Director, | |data is collected by the |Committee constitute a |Committee |quarters was not met |for student success and |

| |& Institutional |Evaluation | |Program Director and is |"panel of experts" who |Nursing Faculty, |although there is |continue to implement |

| |Effectiveness |Committee | |used to evaluate trends in|are qualified to |Advisory Committee|improvement in the class |additional ways to assist |

| |Office | | |these areas by the |evaluate the | |after support services |students. |

| | | | | |graduation/ completion | |instituted. | |

| | | | | |data for trends. | |The goals of 70% in 9 | |

| | | | | | | |quarters was met and | |

| | | | | | | |actually exceeded. This | |

| | | | | | | |is a brief gain and we | |

| | | | | | | |must sustain efforts.. | |

................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download