Mock Code



Project 3: Evaluation of an Instructional Product: Mock Code Competency: Evaluation PlanInstitutional Mock Code TrainingVenice McDougleEDCI 577October 9, 2016Professor Adrie Koehler-BlairPurdue UniversityEvaluation PurposeJoint Commission is responsible for ensuring that safety and standardizing competency are in place to help healthcare organizations to continue to deliver dependable, safe quality care and recognize opportunities for improvement. Joint Commission visited Hermann Hospital March 2015, identifying that the institution did not have a formalized training program for interdisciplinary Code Blue teams. Along with the absence of team training come the threat of poor communication, indecisive leadership, ineffective CPR, delayed response time, and suboptimal patient outcomes during Code Blue events to assess for competency upon onboarding and then an ongoing competency base annually. Hermann Hospital was asked to develop a training program and shows evidence that the education was being provided to the interdisciplinary Code Blue teams. The Mock Code training recommended by the Hermann Hospital Simulation Center was designed to provide training through understanding of how to effectively identify best practices, timely to first administer medication and opportunities to improve response with a focus on basic life support strategies, Zoll defibrillator use, backboard placement, management of airway, code blue event documentation, timing, first compression, compression rate, compression depth, compression fraction, and overall quality of CPR.Hermann Hospital Stimulation Department offers a program known as Mock Code Competency, and it is designed to provide training as well as in-depth comprehension of how mock code event can be administered to both adults and pediatric patients effectively. The purpose of this evaluation was to analyze the instruments, evaluating, budgeting, analyzing the problem, resources, assessing needs, identifying data measurement, and practices that are required to evaluate the program’s effectiveness. In connection with this, the training offered was also structured in a manner that makes it possible for healthcare professionals to obtain the feedback and hone skills that can enable them to master the Mock Code program. By demonstrating skills retention as well as resolving if program adjustments are necessary, and confirming the validity of the evaluation purpose and methods that will effectively assess the types of skills identified (case studies, return demonstration, peer review, self-assessment, mock events/surveys). Finally, by offering a specialized training program, the experts in the Mock Code Simulation Training Department created a platform for the code blue trainers to give the learners a framework needed to allow them to be able to provide rapid response time in a more effective way to treat our patients in a within a timely manner to help save their patients’ lives and provide superior service fulfilling the objectives that allow for easy identification of mock code skills, provide first compression, compression rate, Zoll defibrillator, management of airway, backboard placement, compression depth, compression fraction to both adult and adolescent patients were met. In order to maintain Joint Commission requirements for the training Hermann Hospital developed a Gantt chart with visual tasks, time frame, and dates to ensure the training implementation has taken place within the organization (Appendix D).Primary ObjectiveThe goal of this Mock Code Competency training evaluation program is to assess the effectiveness and objectives of the overall performance in the mock code training program. Hermann Hospital Stimulation Center will ensure and ascertain that the overall performance in the program is effectively measured, the objectives of the training and evaluation must be identified. Simulation Center Training trained for two consecutive weeks around the clock that were distinctly designed for teaching nursing professionals on how performance improvement can be achieved. In order to measure the primary objective of this training program, the focus was on qualitative data in which receiving valid and correct evidence was key in demonstrating a more organization approach in our progress and celebrating our achievements in the area of life support will increase the level of transparency while empowering our bedside staff to identify opportunities for improvement and effectiveness of the Mock Code training program itself. It is a requirement for all staff to demonstrate competency in an effort to ensure patient safety, quality patient outcomes, patient/family satisfaction, and meet organizational goals.Summary of Evaluation PlanAssessing the overall effectiveness of a particular program takes into consideration the use of necessary instruments as well as resources. Obtaining the required results that made it easier to measure the effectiveness of the program was made possible through the use of Kirkpatrick’s 4 levels of evaluation. In this regard, it was easier to assess the reaction of the participants, the lessons they absorbed, possible changes in their behavior, and results of the training program that they undertook. However, measurements used in determining the levels of effectiveness and discrepancies were reviewed from the data results. Further, the preliminary outcome of levels 1, 2, 3, and 4 evaluations will be made available through continuous evaluation and data collection for levels 3 and 4 will delay the final results of the levels 3 and 4.Key FindingsIt was necessary that all information be made available for review if key findings were to be identified easily. The results of the findings will be ready for the last review soon after the completion of data collection. The training session’s outcome for Mock Code Competency indicates that certain important information is necessary for identifying gaps in the evaluation process. However, the key findings from the training sessions include the following:The objectives, goals, and expectations of the program have been met by training.How satisfied were the learners with the mock code training?How the mock code training meets the organizational and joint commission goals requirements?Use of proper chest compressions, basic life support strategies, Zoll defibrillator use, backboard placement, first compression, compression rate, compression depth, compression fraction, ET intubation equipment and activate the code blue team, placement of backboard and placement of airway.Knowledgeable instructor effectively performed the training.The training environment was very conducive for learning.Besides, the data results also revealed the gaps in the training session which include the following:There was not enough time for training follow-upThe training course did not involve the use of current information, hand-off communication, increased familiarity with the equipment, communication, that can support the teaching. RecommendationsThe recommendations for the training program were determined by the outcomes of Levels 1, 2, 3, and 4 evaluations. The data generated will be useful in streamlining the process and making appropriate changes where necessary. In this regard, the proposed recommendations were as follows: More emphasis should be placed on skills validation practices by using different case scenarios pertaining to real life issues.Analysis of mock code event data, trends, and opportunities for improvement will be discussed with key stakeholder’s quarterly.There needs to be detailed policy and procedures to gather the correct data and results.It is necessary to use a control group.Adequate time should be allocated for results in levels 3 and 4. This is because the results can foster changes in the training program. Program Description Evaluation need:Hermann Hospital Simulation Training Department works with all nursing leadership, performance improvement department, and nursing instructors within the hospital to meet professional development and organizational needs relating to patient safety and sustaining readiness to respond to patients that require an emergent level of care in areas designated as clinical according to the Code Blue training of Mock Code Competency. The Simulation Department recognizes the particular need of being trained and how to ensure that all interdisciplinary teams are able to perform a critical assessment, recognizing the need to initiate the use of emergency procedures including basic life support, basic emergency equipment in resuscitation efforts, monitoring, and implementation and provide optimal patient care outcomes, which includes best practice for basic life support strategies.Hermann Hospital Stimulation Training Department has been influential in working closely with the Joint commission and healthcare organization in meeting both professional development and organizational needs on matters pertaining to safe and decent training of Mock Code Events. More specifically, stimulation training is a vital part of nursing professional being trained on how to administered Mock Code within a matter of minutes in adults and pediatric patients. Besides, such a training is established because there is a demand for training Licensed Health Care Interdisciplinary Teams (nurses, doctors, nurse practitioners, nursing assistants and nursing instructors) in the organizations. It is true that Joint Commission requires all healthcare organizations Licensed Health Care Professionals be competency certified in the administration of Mock Code. As well, the training is offered in a self-sustaining training facility capable of handling simultaneous sessions with groups ranging from ten to twenty-five members. In addition, the training site is also capable of offering the essential instruments and resources that are ideal for meeting the needs of the Licensed Health Care Interdisciplinary staff. Purpose of evaluation The evaluation process is usually designed to provide a program that is always aligned with the validation methods that focuses on the improvement of the training service to all Health Care Interdisciplinary staff in the organization and determining how successful the training program, resources allocation were met, determine if outcomes were met, and identifying if indicators were being measured. The code blue evaluator will, therefore, conduct a review of results of training and evaluation methods to determine that the course code blue instructor has trained the participants on the best practice aligned with standard code blue safety measures, and the learner’s’ performance on how to administer Mock Code to adult and adolescent patients. In addition, the process of evaluation also serves as a method of verifying all goals, mission, and objectives are met. Further, the data results provided grounds for determining participants’ satisfaction, involve stakeholder, collect reliable evidence, identifying the long-term impact on nursing professionals the behavioral outcomes and learning styles. The data will be shared with all key stakeholders.Course objectivesEvaluation has been singled out as the best method for measuring the effectiveness of the training. The assessment process of Mock Code Competency Training measured every objective including the engagement of the participants with instruments for administering Mock code to all adult and pediatric patients. However, with reference to Mock Code performance, measuring course objectives included the following. Measurement of course objectives specific to Mock Code performance include the following:Learner will identify location of emergency equipment and procedure for maintenanceLearner will demonstrate use of emergency equipment according to established criteriaLearner will activate the cardiopulmonary resuscitation (Code Blue) team for help Learner will recognize the need for cardiopulmonary resuscitation (Code Blue)Learner’s will perform basic CPR until the Code Blue Team arrivesLearner’s will provide location, floor and room numberLearner Analysis and ContextThe Mock Code training is targeted to all Licensed Health Care Interdisciplinary Teams (nurses, doctors, nurse practitioners, and nursing instructors) who care for patients at Hermann Hospital. This training course was purposefully designed for Health Care Interdisciplinary staff who offer medical services to patients in various settings such as inpatient and ambulatory settings within the clinical and hospital areas. The level of experience for each participant ranges from new graduates to experienced participates. The area of healthcare requires men and women who fall into the age bracket of 25 and 65. The goal of the training is to ensure that all interdisciplinary teams are able to perform a critical assessment, monitoring, and implementation and provide optimal patient care outcomes, which includes best practice for basic life support strategies, defibrillator use, backboard placement, and event documentation. The training strategy is to use healthcare simulation as the bridge between knowledge acquisition and application to real life situations while promoting interprofessional collaboration, safety awareness, and excellence for patients.The content in alignment with the learning objectives for the course was created in collaboration with Code Blue Team and nursing leadership to ensure that the course is current and relevant to meet the needs of nursing professional staff. Besides, the objectives are established in collaboration with the Mock Code Simulation Training Department as well as nursing leadership stakeholders of the within Hermann Hospital Organization. All this is done to ensure that the course provided is current and relevant in meeting the requirements and standards of healthcare practice. To ensure overall effectiveness, the participants are registered in advance so that a balance can be achieved between the number of instructors and that of the participants. The site for the Mock Code Training will be located in the Simulation Center training rooms that are located in a 15,000 square foot state-of-the-art facility. The training is around the clock daily for two consecutive weeks with a seating capacity 100 seating occupancy classroom style set up with ten tables, ten BLS SimMan manikins, Five code blue trainers, audiovisual equipment, television monitors easels, flip chart with markers, laser pointer, LCD projector, podium with computer, screen, video equipment, and computers will be located in the Life Support Simulation Training Center classrooms at the Hermann Simulation Center located at 5624 Bergner, Blvd, rooms 1-10, Houston, Texas 77030. The Code Blue Life support coordinators have experience from an accredited four-year college or university with major course work in a healthcare setting and two years’ experience in Emergency Medical Services (EMS) training/teaching experience with two years in the field with Emergency Medical Technicians (EMT) certification. The program will require one full day, with the first half of the day instructor-led dedicated to the review of the overall concepts and the last half with simulation training check-off. The last two hours of training the code blue trainers will block time for the post-test and course evaluation. All Licensed Health Care Providers who worked at the health care institution were pre-registered to attend by their nurse manager or charge nurse. Level 1: Reaction The level 1 will measure the mock code training sessions provided by Life Support Simulation Training Center it will entirely focus on obtaining the feedback from the Health Care Interdisciplinary staff. Since the training sessions have two components (Instructor-Led and Simulation Check-off), measurement tools and processes are utilized in each of the parts so that the effectiveness of the training session is revealed as the case of our adult and adolescent patients. Mock Code, the course evaluation instrument used also follows the same process as shown in (Appendix A). The survey questions used in collecting data centered on training experience and the Health Care Interdisciplinary staff who take part in this survey will be motivated to provide an honest answer to all questions. The questions will cover all the knowledge and effectiveness of the instructor, duration, materials as well as location. To address the reaction of the participants, a 5-point Likert scale comprised of 15 questions is used to test their training experience. Furthermore, the survey results also provide the participants with an opportunity to have a reflection on the experience that they have had during the training session since it provides an opportunity to make suggestions that are applicable to the instructor’s teaching methods. By responding to these questions, there is an assurance that sufficient data is collected and evaluated. The code blue trainers will oversee of the online evaluation survey. Analysis of the results will be done without revealing participant’s identity. The reaction and data are very crucial, reaction retention will be assessed every 30 to 60 days, with follow-up surveys being delivered to every participant through email using Qualtrics survey evaluation system. Level 2: LearningThe performance outcomes of Mock Code Competency training sessions have made it easier for the Life Support Simulation Training Center as well as the nursing leadership to collect information that is so valuable in determining the effectiveness of the training program. The code blue instructors normally use the evaluation instruments in verifying the ability of the participants to conduct Mock Code. This is because the measuring instruments used are capable of providing skill validation, and significant on return demonstration that’s criteria for mock code (See Appendix C). It is expected that the participants should meet the 100% accuracy check-off if they are to be successful in the course. The instructor determines this mark when it appears that the participants are capable of demonstrating the manual skills and teach back validation correctly for each skill step listed under skill evaluation. The Mock Code Simulation evaluation form will be obtained by the code blue trainers using Taleo our learning management system (LMS) used to enter the needed training information for educational tracking and data gathering. Some of the information collected will include the performance of learners for both measurable and observable performances that define the manner in which the participants apply the skills learned during the course. The collected data is analyzed carefully to assess whether training content matched the learning objectives as well as the teaching methodology utilized. The case scenarios will be completed by the code blue instructor, and the skills validation observation will be tracked by the same code blue instructor, and upon completion of the skill validation check-off, the code blue instructor will check-off the participants as either successful or unsuccessful. Mock Code to our Nursing Professionals entails the following steps:Identify location of emergency equipment and procedure for maintenance.Demonstrate competency in recognizing the need to initiate the use of emergency procedures including basic life support, and all basic emergency equipment in resuscitation efforts. Demonstrate use of emergency equipment according to the establish criteriaState with 100% accuracy, the critical elements in emergency response given several emergency situations.Gather needed equipment and supplies from drawer #5 labeled “Airway and Breathing”.Position self directly above the patient’s head. Position head using head tilt/chin lift technique.Place the mask on the patient’s face, using the bridge of the nose as a guide for proper position.Perform the critical elements of emergency care during mock code exercise.Integrate safety measures in the performance of mock code.Evaluate the impact of training on actual performance during a real code eventTriggering emergency response system.Executing ideal Mock Code techniques such as correct hand placement, correct compression, and desirable rate of 100/min and above. After this skills validation evaluation will be completed, the code blue instructor will provide a timely response to areas of competence. Again, the participants are expected to perform with a 100% accuracy mark without which, the participants will have to be remediated. The remediation can be performed under the code blue instructor’s guidance, asking for additional practice of the skills validation check-off, 1:1 assists with the trainer, extra reading, retaking the assessment or retaking the skills evaluation. In case there is unsuccessful remediation, the participant will have no option but to repeat the course later. Completion of remediation is 30 days, failure of which will result in repeating the course. Otherwise, the code blue instructor will work with leadership to immediately suspended the participants from their job until their able to pass the test. Level 3: BehaviorThis level 3 examines whether training experience has created an influence on the behavior of the participant. With respect to the training offered by Life Support Simulation Training Center, the behavior is gauged on the opportunities that create positive change and the application of the knowledge. Data gathering for this level is set 90 days after the training. The participants who have completed the Mock Code training will be contacted by Life Support Simulation Training Center for an interview. For example, the interview is held with the stakeholders, nursing leadership, nurse managers, clinical nurse leaders, clinical coaches as well as a control group. By including these people, it becomes possible to collect data from the preceptor, clinical nurse leaders and managers who will be able to identify first if there was a change in the participant's behavior due to training. The questions asked revolved around the learned competencies, the mock code training program as well as their position description (See Appendix A). The use of a grading scale in answering the questions was necessary for determining the satisfaction level or rather; the behavioral change that was observed after the training ended. The participants had an opportunity to have an interview schedule on site at Life Support Simulation Training Center before participating in the evaluation. The goal of level 3 evaluation is to focus on data gathering with respect to the behavioral change of the participant. This will help in determining whether participants had applied the knowledge and proficiencies to their job position, which was part of the assessment process. The interview data gathered will depend on upon the validity of the learning experience brought about by professional growth and individual development. Level 4: ResultsLife Support Simulation Training Center has shown a commitment to providing qualified nursing professionals training within the organization with sufficient training to enable them to carry out basic mock code skills. Levels 1, 2, and 3 evaluations are all aligned with the goal of the training program. Level 4 evaluation measures the achievement of the training program in respect to the quality of patient care, cost, training, and knowledge applied to their jobs and their satisfaction with the healthcare institution as a whole. Caring is one of the core values of the healthcare institution. The measurement of caring is reflected in the patient satisfaction scores. Patient satisfaction is a foundation measure of the patient experience.? The data from the patient satisfaction surveys help us understand the complex relationships between organization brand, clinical, safety and financial measures.??Measuring patient satisfaction and safety helps the organization learn how we are doing and what we need to improve. The code blue leaders needed to provide the nursing leadership team with financial analysis of the mock code program and the return on investment. The code blue team used the data to determine the cost of the development and implementation of the Mock Code Training it was based on the participants’ rate of pay at $65.00 per hour, which is then calculated by how many times the learners attended training. This is a practical estimate of the income of the nursing professional staff in the organization. The code blue team leaders will continue to collect the data in order to provide the cost on the ROI for future and current training. The survey will provide Hermann Hospital mean scores for each question as well as comprehensive peer group comparisons. Training provides a level of competency that directly impacts our patients, clinical outcomes, directly impacts our patient's satisfaction scores, clinical quality indicators and outcomes, which can lead negatively to diminishing the core values of the organization as well as the brand to the public.Conclusion: Data Collection & AnalysisData collection is perceived to be essential and plays an integral role in the assessment process since it determines the validity of the mock code training program. The needs for improvement have been identified simply by collecting valuable data by Life Support Simulation Training Center. The data will consist of pre-mock and post-mock code times training for all code blue events. Nevertheless, there was a greater need to apply certain guidelines as well as practices that would ensure that the best results are achieved. Kirkpatrick & Kirkpatrick (2006) assert that when a control group is used, adequate time should be allocated if the outcome was to be successful, and in this case, measuring the program prior and after training was ideal. When a control group is used for evaluation, the participants would be derived from the client’s organization. The resulting data from the surveys as well as questionnaires provide better grounds for finalizing the analysis. The Taleo learning management system will store the data collected from levels l and 2 evaluations, and this makes it possible to analyze them with ease. The outcomes that are derived from evaluations are reported on a quarterly basis to Life Support Simulation Training Center committee. As provided in (Appendix E), the scores of level 1 evaluation will be averaged. For example, any score that on average is less than 3 on the Likert scale should be revisited to identify any need for adjustment as well as participant’s satisfaction. Level 1 reaction is basically a measure of participant’s’ satisfaction, and to assist in assessing the efficacy of the mock code training program, the reaction should be favorable (Kirkpatrick & Kirkpatrick, 2006). Level 2 evaluation shows an analysis of participants who need remediation, and by careful analysis, critical performance criteria could be determined. Therefore, such data are useful in identifying particular learning gaps. Levels 3 and 4 reports useful information that is essential in improving training programs in the future, and according to Kirkpatrick & Kirkpatrick (2006), the code blue instructors should also find an opportunity to evaluate their own effectiveness. By reporting to stakeholders at Life Support Simulation Training Center and Nursing leadership, there is an assurance that the course remains relevant and current. Process and TimelineThe stakeholders at Hermann Hospital were furnished the evaluation plan process on June 20, 2015. Stakeholders include Health Care Interdisciplinary staff, RN’s, Advanced Practice Nurses, Pediatric doctors, code blue team and nursing leadership who met occasionally to discuss the needs analysis relating to the Mock Code Competency. The stakeholders, finalized discussing the need, made an educational evaluation plan draft, which was completed between July 5, 2015, and August 21, 2015. On September 12, 2015, the plan to determine the tools for evaluating the four levels was adopted. As for level 1, a survey was considered a perfect tool for evaluation reaction, and this was implemented between September 12, 2015, and October 18, 2015. In addition, Likert scale method was preferred for data gathering. Between June 14 and June 20, 2015, an instrument for collecting information on level 2 was determined, and this included evaluation tools for the adults and pediatric patients, which described much on when to administer Mock Code. A determining instrument for levels 3 and 4 began on June 21-27, 2015. For example, a survey was preferred in collecting data that touched on the behavioral changes during the entire course. The data collection process began on August 21, 2015, ending on September 27, 2015. These dates are related to level 1 and 2 data analysis, and they will help in identifying any inconsistent knowledge gaps as well as strengths and weaknesses of the entire training process. Further, analysis of levels 3 and 4 by Life Support Simulation Training Center was extended from May12, 2016, to June 18, 2016, are the dates for analysis. Overall, the outcomes gathered by Life Support Simulation Training Center, with evaluation reports delivered to the stakeholders, doctors, nursing leadership, and health care interdisciplinary staff marked the completed (Appendix D). ___________________________________________________________________________AppendicesAppendix A. Level 1 Reaction Mock Code Training Feedback SurveyAppendix B: Level 2 Mock Code Online Quiz Appendix C: Level 2 Mock Code Simulation Evaluation FormAppendix D: Gantt Chart TimelineAppendix E: Level 1 Mock Code Evaluation SummaryAppendix A. Level 1 Reaction Mock Code Training Feedback SurveyThis survey has been designed in order to compile feedback on your experience attending the Mock Code instructor-led training. Please fill in the appropriate box with your answer to help us improve our training. Appendix B: Level 2 Mock Code Online Quiz Appendix C. Level 2 Mock Code Simulation Sample Evaluation FormAppendix D: Gantt ChartAppendix E. Level 1 Mock Code Sample Evaluation SummaryReferencesJoint Commission on Accreditation of Healthcare Organizations; JC Commission (2005). Hospital Accreditation Standards: Standards, Intents: HAS. Joint Commission on.Kirkpatrick, D. L., & Kirkpatrick, J. D. (2006). Evaluating Training Programs. San Francisco: Berrett-Koehler Publishers, Inc.Resuscitation Services are available throughout the hospital.” Standard: PC.02.01.11. Comprehensive Accreditation Manual for Hospitals (CAMH), January 2013.The hospital collects data to monitor its performance.” Standard: PI.01.01.01. Comprehensive Accreditation Manual for Hospitals (CAMH), January 2013. ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download