Vatraining.remote-learner.net



Introduction to Health Care Data Analytics(BIS Nbr: 1981)EES Program Evaluation Report of ResultsDeveloped by:Employee Education SystemProgram Evaluation & Measurement Unitin collaboration with ADUSH for Informatics and Analytics (10P2) - (Office of Informatics and Information Governance) Chief Improvement and Analytics Officer-Reporting, Analytics, Performance, Improvement and Deployment (10EA) ADUSH for Patient Care Services (10P4) (Pharmacy Benefits Management Clinical Informatics and Reengineering)Bellevue College, WA StateDate: 5/12/2017Version 1: FINALTable of Contents TOC \o "1-3" \h \z \u Executive Summary3Program Overview5Program Description PAGEREF _Toc482361339 \h 5Program Format PAGEREF _Toc482361340 \h 5Target Audience PAGEREF _Toc482361341 \h 5Program Objectives PAGEREF _Toc482361342 \h 5Evaluation Results7Participant Learning & Skill Acquisition (Level 2 Results): PAGEREF _Toc482361344 \h 9Barriers and Enablers (Factors Contributing to Application) PAGEREF _Toc482361345 \h 17Additional comments: PAGEREF _Toc482361346 \h 18Summary of Findings22Major Findings and outcomes PAGEREF _Toc482361348 \h 22PROJECT STRENGTHS PAGEREF _Toc482361349 \h 22Lessons Learned about the project PAGEREF _Toc482361350 \h 22Lessons Learned about the Evaluation PAGEREF _Toc482361351 \h 22Recommendations/Next Steps PAGEREF _Toc482361352 \h 23Appendix A: Shared Responses24Appendix B: Additional Documents28-136221-61595Executive Summary00Executive SummaryEvaluation ResultsProgram DescriptionPurpose: This knowledge and skills based web training provided foundational skills in health care data analytics. It was designed to equip learners to contribute more effectively to local data analytics and performance improvement efforts.Dates: The training was held from 10.03.2016 to 02.06.2017Modality: Web-MoodleTarget Audience: 321 participants completed the program; they were primarily Physicians, Nurses, Psychologists, Pharmacists, Mental Health Counselors and Informatics and Analytics Personnel.Objectives:Discuss the role of data analytics in quality and performance improvement effortsDescribe the tools and techniques used for data analytics in health care organizations, and Identify techniques to communicate insights gained from data analysisParticipant satisfaction (level 1)351 online surveys were completed within 30 days of training. This number includes the pilot participants and participants who completed the evaluation more than one time Overall, 94% of respondents reported being satisfied by marking either “Strongly Agree” or “Agree” across all satisfaction items and an overall mean of 4.52 (on a five-point scale).Respondents remained satisfied with their experience 3 months later, with an overall mean of 4.52 on the follow-up evaluation.Learning / Skill Acquisition(Level 2)Overall, 96% of respondents reported learning new skills by marking either “Strongly Agree” or “Agree” across all learning items and an overall mean of 4.62 (on a five-point scale).Overall, respondents believed they accomplished the objectives, with 96% marking either “Strongly Agree” or “Agree” across all objectives, and an overall mean of 4.57 (on a five-point scale)Application / Job Impact (level 3)321 participants completed the program129 follow-up online surveys were completed 3 months following the training program for a response rate of 40%. Participants indicated that they were successful in utilizing the training, with an overall mean across all 11 implementation items of 4.32 (on a five-point scale) 87% of participants indicated that they shared the content of this training with coworkersRespondents perceived a 16% improvement in their job performance as a result of participating in the program On average, 73% of respondents agreed that the program improved the VHA strategic objectivesBarriers & Enablers (Factors Contributing to Application) The top three barriers were:33%: Time to apply21%: Resources (money, equipment) 9%: Work Environment (policies, procedures)The top three enablers were:83%: Motivation to apply content74%: Ability to apply content73%: Knowledge and Skill to apply contentRecommendationsReview participant comments for possible course additions/changesConsider developing advanced analytics courseworkContinue to broadly advertise and promote this course across disciplines/fields/program officesShare evaluation findings with VA leadership to ensure continued support Work with VA leadership to promote staff release time to complete this courseMonitor course enrollments and completions to determine ongoing demandPromote course to Department of Defense studentsAdvise participants to complete Level 1/2 survey only one time-142875-213995Program Overview00Program OverviewProgram DescriptionHealth care organizations are under increasing pressure to improve performance, increase efficiency, reduce costs, better manage chronic disease and high-risk patients and advance evidence-based care. VA is under extreme pressure to improve access, performance, patient safety and efficiencies. VHA employees, in three separate national surveys, indicated health care data analytics as their number one training need. The introductory?health care data analytics training program was developed in response to the pressing need for analytics skills at the U.S. Veterans Health Administration to manage and leverage the tsunami of health data available. The course was developed by VA data analytics subject matter experts and health informatics staff in conjunction with Bellevue College with funding from the Office of the National Coordinator for Health Information Technology (ONC) through the U.S. Department of Health and Human Services. The purpose of this knowledge-based web training is to provide foundational skills in health care data analytics. It is designed to equip learners to contribute more effectively to local data analytics and performance improvement efforts. Program syllabus included in Appendix A.Program Format This course was 100% online, with convenient 24/7 access that allowed participants to complete the weekly assignments on their own schedule. The course was offered online using Moodle software. The course included voice-over power points, audio transcripts, readings, assessments, knowledge-checks, glossaries, hands-on interactive activities, video tutorials, questionnaires and online discussion forums. An extensive list of optional resources was also available. Course work was primarily asynchronous (independent, self-paced) and was facilitated by Faculty Moderators. Link to information page: Audience321 participants completed the program; they were primarily physicians, nurses, psychologists, pharmacists, mental health counselors, and informatics and analytics personnel.Program ObjectivesAt the conclusion of this training, participants were expected to be able to:Discuss the role of data analytics in quality and performance improvement effortsDescribe the tools and techniques used for data analytics in health care organizations, and Identify techniques to communicate insights gained from data analysisThe subject areas include: Introduction to Quality Improvement and Data Analytics Health Care Data as an Organizational Asset Working with Data Data Analytics Tools and Techniques Using Data to Solve Problems Using Data to Tell the Story-190499-204470Evaluation Results00Evaluation ResultsData Collection Method(s) For Levels 1 and 2:The following was the primary data collection method used to measure participant satisfaction as a result of attending this program:Survey: Program participants were asked to complete the EES standard program evaluation survey immediately following the training. The survey was an online evaluation form using TMS with standard questions focused on determining satisfaction and reaction. Participant Satisfaction (Level 1 Results):This section reports the findings that demonstrate the program’s effectiveness at meeting participant expectations, accomplishing program objectives and obtaining a positive reaction from the target audience.Summary of Key Findings:Overall, 94% of respondents reported being satisfied by marking either “Strongly Agree” or “Agree” across all satisfaction items and an overall mean of 4.52 (on a five-point scale).Respondents remained satisfied with their experience months later, with an overall mean of 4.52 on the follow-up evaluation.Results:The following items asked participants to indicate their level of satisfaction regarding various components of the learning activity. For each item, they were provided with a five-point response scale, ranging from “Strongly Disagree (SD)” (1), to “Strongly Agree (SA)” (5). There is also a “Not Applicable (NA)” option. The results are listed in the table below.Table 1.1: TMS Results (Participant Satisfaction) QuestionSDDNASANAMeanOverall, I was satisfied with this learning activity. (N-351)1%(3)1%(2)3%(12)28%(97)67%(236)0%(1)4.60I will be able to apply the knowledge and skills learned to improve my job performance.(N-351)<1%(2)0%(1)5%(19)34%(117)60%(210)<1%(2)4.52The scope of the learning activity was appropriate to my professional needs.(N-351)1%(2)1%(5)4%(14)34%(119)60%(210)0%(1)4.51The training environment (face to face, video conference, web based training) was effective for my learning. (N-351)1%(4)1%(4)6%(22)33%(117)58%(203)0%(1)4.46MEAN4.52*This question was asked both immediately following the training, and again Three months later in order to assess if participants still believed they benefited from the training after they had some time to implement what they learned. As the results in Table 1.1 show, immediately after the training, respondents were very satisfied with the training, with this question yielding a mean of 4.6 (on a five-point scale). Three months after the training, participants remained satisfied, with an overall mean from 123 respondents of 4.52 (again, on a five-point scale). This suggests that the participants perceived the trainings as satisfactory even after having the opportunity to apply the training in their role or work environment.Participant Learning & Skill Acquisition (Level 2 Results):This section reports the findings that demonstrate the program’s effectiveness at achieving the learning objectives.Summary of Key Findings:Overall, 96% of respondents reported learning new skills by marking either “Strongly Agree” or “Agree” across all learning items and an overall mean of 4.62 (on a five-point scale).Overall, respondents believed they accomplished the objectives, with 96% marking either “Strongly Agree” or “Agree” across all objectives, and an overall mean of 4.57 (on a five-point scale)Results:The following items asked participants to indicate their level of learning regarding various components of the learning activity. For each item, they were provided with a five-point response scale, ranging from “Strongly Disagree (SD)” (1), to “Strongly Agree (SA)” (5). There is also a “Not Applicable (NA)” option. The results are listed in the table below.Table 2.1: TMS Results (Participant Learning)QuestionSDDNASANAMeanI learned new knowledge and skills from this learning activity. (N-351)1%(3)1%(2)2%(8)27%(96)69%(241)0%(1)4.63The learning activities and/or materials were effective in helping me learn the content (i.e., handouts, assessment tools, etc.). (N-351)<1%(3)<1%(2)3%(10)28%(98)68%(237)0%(1)4.61MEAN4.62Next, participants were asked to indicate their level of agreement regarding the extent to which they believe they achieved the learning objectives of the training course. Participants were provided with a five-point response scale, ranging from “Strongly Disagree (SD)” (1), to “Strongly Agree (SA)” (5). There is also a “Not Applicable (NA)” option.Table 2.2: Course ObjectivesQuestionSDDNASANAMeanDiscuss the role of data analytics in quality and performance improvement efforts (N-351)1%(2)0%(0)3%(11)34%(119)62%(218)0%(1)4.57Identify techniques to communicate insights gained from data analysis (N-351)1%(2)0%(0)3%(11)35%(121)62%(216)0%(1)4.57Describe the tools and techniques used for data analytics in healthcare organizations (N-351)1%(2)0%(0)4%(14)34%(119)61%(215)0%(1)4.56MEAN4.57Job impact / Job Application (Level 3 Results): This section reports the findings that demonstrate the program’s effectiveness at participant’s ability to apply the skills learned from the program on the job.Data Collection Method(s):The following were the primary data collection methods used to measure participants’ application of skills learned as a result of attending the program:Survey: 321 program participants were asked to complete a follow up program evaluation survey Three months following the training. The survey was an online evaluation survey with questions focused on job impact and skill application. 129 surveys were completed for a response rate of 40% Summary of Key Findings:Participants indicated that they were successful in utilizing the training, with an overall mean across all 11 implementation items of 4.32 (on a five-point scale) 87% of participants indicated that they shared the content of this training with coworkersRespondents perceived a 16% improvement in their job performance as a result of participating in the program On average, 73% of respondents agreed that the program improved the VHA strategic objectivesResults:The following results are presented from the follow up survey for the program.Participants were asked if they had taken a data analytics course in the past. 129 participants responded. 47 respondents indicated yes, 73 respondents indicated no and 9 respondents were not sure. Demographics by Job TitleThe table below shows respondents by job title. Table 3.1: Job TitleJob TitleNumber of RespondentsAllied Health (Lab, X-ray, PT, OT, Audiology/Speech/Language4Data Analyst14Dietitian1Educator6Group Practice manager1Health Information Management2Health Informatics Specialist/Clinical Application Coordinator13Health System Specialist/Program Analyst13Licensed Vocational Nurse/Licensed Practical Nurse1Medical Librarian1Pharmacist4Psychologist/Clinical Psychologist1Quality Improvement/Quality Management11Registered nurse (RN,CNL,CNS,NP,CRNA)32Other*25TOTAL129 Other*- Administrative Officer – 4, Annual Report Coordinator, Care Coordinator, Clinical Informatics Nurse Specialist, Compliance, Credentialing, HSS, Informatics Nurse, Management Analyst, Medical Support Assistant, Program Analyst -2, Program Application Specialist, Program Assistant, Program Specialist, Program Support Assistant- 4, Psychology Technician, Research, Vera Coordinator/program AnalystEducational BackgroundThe table below shows respondents educational background. They had the option to select all that apply. Table 3.2: Education LevelNumber of RespondentsNo college6Some college (but no degree)4Associates (AA,AS)8Bachelors (BA,BS)32Masters (MA,MS73Doctorate (MD, PhD)10TOTAL129Time in VAThe table below shows respondents by time in VA. Table 3.3: Tenure for VATimeNumber of RespondentsLess than 1 year51-3 years154-6 years227-9 years2410-12 years1813-15 years416-18 years1219+ years29TOTAL129Success in Skill ApplicationParticipants were asked to rate their level of success in implementing various behaviors related to the training objectives. Response options were: “Not Successful” (1); “A Little Successful” (2); “Moderately Successful” (3); “Successful” (4); and “Very Successful” (5). Respondents were also provided a ‘Not Applicable” response option. The table and chart below displays the frequencies and mean for each skill, respectively.Table 3.4: Skill Application Frequency of ResponsesObjectiveNot SuccessfulA Little SuccessfulModerately SuccessfulSuccessfulVery SuccessfulMeanSuccessfully collected data for analysis at least once in the past three months (N-116)1%(1)1%(1)5%(6)27%(31)66%(77)4.57Utilized software (such as Excel) to enter and summarize data both numerically and visually, in order to facilitate data analysis at least once in the past three months (N-122)0%(0)2%(2)3%(4)31%(38)64%(78)4.57Provided a summary report of VA data to peers or administration at least once in the past three months (N-114)1%(1)4%(4)2%(2)34%(39)60%(68)4.48Identified and remediated errors in a data set or a calculation at least once in the past 3 months (N-103)1%(1)2%(2)4%(4)39%(40)54%(56)4.44Utilized project management skills and methodology in at least one quality improvement project within the past three months (N-102)1%(1)3%(3)6%(6)34%(35)56%(57)4.41Created and shared a visual depiction of quantitative information at least once in the past three months (N-112)2%(3)4%(4)8%(9)29%(32)57%(64)4.34Given an existing issue or business problem, identified an analytic strategy to provide a potential solution at least once in the past three months (N-98)3%(3)4%(4)8%(8)34%(33)51%(50)4.26Crafted appropriate metrics and indicators for a performance improvement project at least once in the past three months (N-95)4%(4)7%(7)8%(8)26%(25)54%(51)4.18Crafted an executive summary or leadership report related to data analysis at least once in the past three months (N-95)6%(6)5%(5)6%(6)28%(27)54%(51)4.18Utilized Lean methodology and toolsets on a quality improvement project within the past three months (N-97)5%(5)7%(7)9%(9)29%(28)49%(48)4.1Accessed the Corporate Data Warehouse to query data to solve a business problem at least once in the past three months (N-96)10%(10)6%(6)9%(9)23%(21)52%(50)3.99MEAN4.32These results indicate that learners were successful with applying the skills learned with an overall mean of 4.32 (on a five-point scale). Participants were asked to report if they had shared the content of this learning activity with their coworkers. 87% “agreed” or “strongly agreed” that they had shared content with others.Participants were also asked to indicate the perceived improvement (in percent) that the training had on their ability to perform their job. Overall, as a result of only this training, respondents perceived a roughly 16% improvement in their ability to perform in their job. VHA ObjectivesParticipants are also asked to reflect upon their experience at the conference and indicate whether or not it improved the three VHA strategic objectives. The objectives and responses from participants may be found in Table 3.5. The table provides the number of respondents, followed by the percentage in parentheses, that endorsed each response option (i.e., yes, no, I don’t know.) The results suggest that overall; respondents believed the training improved the strategic objectives of VHA.Table 3.5: VHA Objectives (N-123)YesNoI Don’t KnowProvide Veterans personalized, proactive, patient-centered care811329Achieve measurable improvements in health outcomes100617Align resources to deliver sustained value to Veterans90825MEAN90 (73%)9 (7%)24 (20%)Shared Strategies: Participants were also asked to provide one strategy they had applied at their facility as a result of completing the training. A total of 87 participants took this opportunity and provided additional items. Participant Comments: The following responses are taken directly from the survey, as the respondent typed them. (They have not been edited in any way). Additional comments are located in Appendix A.Created a database for tracking beneficiary travel clerk productivity, resulting in the elimination of processing backlogUtilization of graphs and charts to explain my written data. it was a great support tool. This class also helped me to organize my thoughts for the written portion so the data could reinforce the points and clarify the thought CAUTI monitoring and creating an action planMissing dose lean project, that used visual data representations and fishbone diagram to identify the improvement areas.Graphs that include two sets of data that demonstrate a dual relationship Developing an Excel worksheet for Last FY PRPs per VERA Patient Class and Veteran Priority Group - to estimate our potential VERA earnings for FY18. Developing to help our CFO be prepared for VISN Medical Center Allocation System meetings for FY18 budget.I am able to utilize our sharepoint site and export data from sharepoint into excel spread sheets. I have not have a lot of opportunities to utilize what I learned from the course but I have the materials saved for reference. I highly recommend the course. I had to validate the revisit rates for Mental Health Veterans, I utilized the skills from the course to abstract the data and create the pivot tables to validate the actual numbers and share with leadership.Barriers and Enablers (Factors Contributing to Application)This section reports the findings of the factors that either contributed to facilitating successful accomplishment of objectives (Enablers) or those that inhibited the successful accomplishment of objectives (Barriers).Key Findings:The top three barriers were:33%: Time to apply21%: Resources (money, equipment) 9%: Work Environment (policies, procedures)The top three enablers were:83%: Motivation to apply content74%: Ability to apply content73%: Knowledge and Skill to apply contentResults:Respondents were provided with the following list of barriers and enablers and were asked to indicate which factors, if any, contributed to or impeded their ability to apply what they learned from the training program to their workplace. Participants were provided with ten different factors and asked to indicate whether or not each factor acted as a barrier or an enabler. The results in Table 4.1 provide both the number of respondents who marked each factor and the corresponding percentage.Table 4.1: Barriers & Enablers Factor# Respondents Citing as Barrier (N-120)# Respondents Citing as Enabler (N-120)Motivation to apply content0 (0% of total respondents)99 (83% of total respondents)Ability to apply content1(<1% of total respondents)89 (74% of total respondents)Knowledge and Skill to apply content2 (2% of total respondents)88 (73% of total respondents)Manager support7 (6% of total respondents)74 (62% of total respondents)Time to apply40 (33% of total respondents)46 (38% of total respondents)Resources (money, equipment)25 (21% of total respondents)35 (29% of total respondents)Co-worker support5 (4% of total respondents)52 (43% of total respondents)Work environment (policies, procedures)11(9% of total respondents)66 (55% of total respondents)Opportunity to apply content8 (7% of total respondents)85 (71% of total respondents)Applicability of the content to my job4 (3% of total respondents)83 (69% of total respondents)None55 (46% of total respondents)5 (4% of total respondents)Additional comments: Participants were given the opportunity to provide additional comments on the follow up survey. (Note: The following responses are taken directly from the survey, as the respondent typed them. They have not been edited in any way.)The Class was GREAT! I would enjoy taking it again to just learn and retain more information. The Tool Box had great information and great resources. Everything that is taught in the Class is information that AHIMA trying to offer certification in a new credential they offer for HIMS Professionals. Informational Governance is a new process that is also being discussed by AHIMA in the outside world and is directed towards HIMS professionals. The VA systems lag behind the outside world for processes and changes. Staff are hired in areas that fit OPM guidance and not for what is occurring in the dynamics of the Health Care world outside of VA. Positions are being down graded and the most educated staff or qualified staff are not applying for down graded positions.It was an excellent courseThis course was very helpful to me and I am really thankful the additional resources lists that was provided to us to utilize. It was a great learning opportunity and I have been encouraging my co workers to enroll soon.this course exceeded my expectations. I was so good. it gave me the confidence to enroll in the healthcare data analytics certification course. I have completed course 1 and start course 2 of 4 on april 26th. Thanks so muchExcellent course to re-acquaint me with various tools for improvement. I used various TQM tools in the USAF but haven't had the opportunity to be a part of an improvement team in the VA.great introductory course. Hoping there will be an intermediate level in the future.I would prefer less reading and more applicable workThe majority of the information provided was covered in my previous HIMS education. This course was more of a refresher.it was a great course, I really liked the hands on exercisesI would've liked to have more hands-on activities in Access, Excel, and SQL techniquesVery good class for anyone working with data analyticsI believe this course was very informative and extremely useful, the training mode was wonderful. It gave me a better understanding of how important my role and responsibilities are as a data analystThere are many, many opportunities to apply the skills learned. The data always reveals areas for improvement. However, leadership as well as peers are resistant to making changes. Without complete buy-in, it is rather pointless. The culture must change in order of this to be usefulIt would have been really helpful to have handouts regarding use of Excel to calculate and graphically represent data and to graphically represent information and data in PowerPoint presentations.I enjoyed the course, which I would have time to practice skills as I took course. Poor interaction with course on my part, completed in batchOverall course was excellent, would take a follow-up if one were offered. The extra resources listed will be valuable for reference. Some of the exercises with multiple screens could be broken up. It was difficult to find a stopping place when needed with out concern for starting over.None.n/aThis is a great course. I hope you'll build upon it and provide advanced training in the future.I found the historical information very dry, but important.I look forward to more courses in data analytics.Because much of the content I knew beforehand, it's hard to say that for me (specifically), the training didn't have as much impact on how I do my job after completing training.Enjoyed the coursevery informative course.I thoroughly enjoyed the course and even informed my colleagues about it. Often times with online courses, you don't really absorb the information for sustained periods of time. I actually took the time to understand the concepts to be able to use it in my role and future roles to come.Right after completing the course, I began the process of obtaining Black Belt Certification. I feel this course was definitely a great refresher and helpful to me in passing the VA Case Black Belt Certification TestThis was an excellent course and I am looking forward to taking more courses like it.Great Course. Would recommend to everyone interested. My only suggestion would be to reconsider using some of the content that was provided by commercial entities. For instance the articles from Collibra and Health Catalyst. The articles used are really advertisements for their products and services disguised as journal articles.Excellent course.great course - comprehensive, however somewhat overwhelming for the recreational analyst.I wasn't too fond of the bloggingI enjoyed learning about the history of Visualization. Great job! connecting the dots...to the emergence of Visualization to the 21st century.I have encouraged others to take this course.Would have preferred more hands-on work. More time spent truly working with data sets instead of just reading/reviewing.N/AIt is important to clarify that this is not a training to learn about analytics tools especially Pyramid and/or development of dashboards.It was kind of hard to navigate to the last part of the course. Case Studies...this could be a user issue.As an introductory course I thought it was both challenging and engaging. It increased my knowledge about data analytics and interested me in doing more in this area. I hope for this opportunity in the near future.It was very resourceful and the networking helped a lot fostering general VA teamwork since we are one VA.This provided a refresher course from past job experience in the private sector. Thank you.It is a well designed course. While taking this course I reflected on how beneficial this would be in all Health Information college programs.Maybe have short and effective stories by health care providers talking about changes that were made, maybe patients, maybe teams with a data person and the health care team speaking to their successes, improvements or even failures.Great course, it really enhanced my current skill set.When is the part II? Advanced courses that we can continue to enhance knowledge acquire. Also identify the graduates, per visn/area, to recognize and to use as resource by administration.It is a great introductory course for people who are not necessarily involved in the daily processing of health care data.This course stood out among other analytics courses. It's approach was easy to follow and apply in a relevant work setting. The presentation was understandable regardless of whether an employee has a statistical background. The course itself presented the material in a wonderfully engaging method. Thank you!needs more analysis teachings. the title of the course is misleading. I expected to learn more statistical methods, instead we were taught how to handle efficiency issues. the title of the course should be changed.This course is extremely important to the field. I encouraged a PSA in Optometry to complete the course and have spread the word to watch for this course in the future. It is critical to the mission of the VHA. Thank you for the opportunity to participate!!?-148374-303386Summary of Findings00Summary of FindingsMajor Findings and outcomesParticipants indicated that they were successful in utilizing the training, with an overall mean across all 11 implementation items of 4.32 (on a five-point scale) 87% of participants indicated that they shared the content of this training with coworkersRespondents perceived a 16% improvement in their job performance as a result of participating in the program On average, 73% of respondents agreed that the program improved the VHA strategic objectivesParticipants utilized acquired knowledge from course to implement strategies at facilitiesParticipants appreciated the self-paced, interactive, hand-on learning experience.Participants appreciated the applicability of exercises to real work issues and tasks64% of participants held a higher level degree (Masters or Doctorate)PROJECT STRENGTHSOngoing support for students to include reminders and additional resourcesAdditional resources provided after course was finishedLearning activities used real world problems (e.g. Case Study-Reducing Catheter Associated Urinary Tract Infections)The ability to earn professional continuing education units motivated many participantsOngoing support from SMEs/program developers to customize Level three evaluation questionsResponse rate on level 3 survey was 40%Lessons Learned about the projectIncrease length of time to complete course Demand for course resources to be available to students on an ongoing basis Communicate value of course to VA leadership to ensure staff release time is availableLessons Learned about the EvaluationDiscuss evaluation at the beginning of the courseInclude information about the follow-up survey in TMSParticipant job titles could be better defined to clearly differentiate job title vs licensure to eliminate some of the Other responsesParticipants are able to take Level 1/2 survey more than one time Recommendations/Next StepsReview participant comments for possible course additions/changesConsider developing advanced analytics courseworkContinue to broadly advertise and promote this course across disciplines/fields/program officesShare evaluation findings with VA leadership to ensure continued support Work with VA leadership to promote staff release time to complete this courseMonitor course enrollments and completions to determine ongoing demandPromote course to Department of Defense studentsAdvise participants to complete Level 1/2 survey only one time-194945-263525Appendix A: Shared Responses00Appendix A: Shared ResponsesParticipant Comments on shared strategies at facilities (continued from page 14): (They have not been edited in any way.)The overview of how to present data-I have used this skill at least once a weekly since course. I also am more aware of the data I need and how to ask for it. I am realizing that there are reports that could be built to improve accuracy and time it takes to get information for patient carecreating delimited fileman reports for sort, filter, and highlights for services completed by patient, service and visit dates.made me more aware of data presentation in crafting the report to leadership and using a different type of graphic than previously used.All strategies I have applied were underway prior to participation.dashboard showing coding and documentation changes since implementation of trainingChanged output formats of several analysis reports based on audience for greater impact; have used fundamental information from the course with respect to value of analytics to advocate for dedicated analyst in order to put the information we're generating to practical use.Data miningusing excel graphing typesPower Point presentation knowing the audience making simple and shortRoot Cause Analysis and Process Flow chart in determining why RTC orders are not being utilized by providers and MSAs.Was able to successfully convey a needed changed based on proof obtained by using data analytics.ChartingUse of Excel has improved but I still have much to learn.Provided assistance to other peers on how to make data tell the story, choosing the correct display for reports in order to complement written reports that only list data.Providing analysis of SAIL data to assist teams/champions to focus improvement efforts.How to pull the right type of data.Better able to understand the data to help coach facilities to improvement.To be honest, I have been using these methods for a long time and enrolled in this course only to ensure my line of thinking was in line with VA, but I believe the course was excellent.I used data visualization strategies to keep graphs simple and let the data speak for itself.the doors to change are not open. Information can be provided.utilizing data from the fileman repository to incorporate in a report to leadershipBringing together teams to analyze the data has been a key strategy to improving outcomes and making change. Finding the right balance to ensure representation from all points, while keeping the group small enough to manage is very important.I didn't necessarily do anything different or applied anything I learned from the course specifically. This may be because much of the content was just a refresher for me and for other things, I just haven't had to apply the skill in the past 3 months. For the latter, I was saying I wasn't successful but it was because I haven't had the opportunity to apply.n/abetter visual presentation of dataOne strategy that I applied after learning it in the HCDA course was specific to Lean reporting. Being able to report on issues identified with corrective actions and implications is truly important in using data for research and QI purposes.I created a run chart and a bar chart to show various trends reflected in the data dump I received.Ability to do cost analysis, much needed statistics reviewParedo Charts! After being re-introduced to the paredo chart during the training, I watched the you tube by Eugene O'Loughlin on the topicI have applied the Lean/Six Sigma strategy to improve patient outcomes in our clinic.I have been working on using a run chart.More proficient at compiling meaningful analysis reports.The development of a dashboard for monthly review of select VHA performance measures with senior leadership, choosing the right data, building models that predict and optimize business outcomes, transform organizational culture, and reviewing action plans.telling a story when presenting dataI'm constantly using SQL for any new query's needed for Lab Test AnalysisI've started doing some test predictive analytics with one of my projects. However, the underlying system is about to be changed so I will have to see what data is available in that system and then carry on from there.I was able to pull productivity, clinic utilization, # of encounters and # of uniques by provider and went over that information with QUAD members.Fishbone diagramusing a critical eye to review data presented to make sure it includes data source, time frame etcI'm using Pivot Tables more!I have tried presenting data in different methods - run charts, pareto, etc.I have applied skills learned from Healthcare Data Mining to several administrative projects that I have worked on over the last three months with special emphasis incorporating data analysis and visualization.Generated solid presentation using data collected.Alternative charts instead of using just pie charts.ability to use data, lean and graphs to do a green belt project and enlighten front line staffI was able to understand Run Charts and how to apply it to my work.I could re-established the BCMA Variance Log. I need to clarify that although this is an excellent training it is most on interpretation and use of data and not to develop skills on analytics tools as others might think.Determining the data sources and the quality of the data led to a different method of capturing our falls data.Using the QI methodology to assist nursing staff with improvement projects.Proposed need for Research Support based on data pullsCreating tables for trending...will have to go back for a refresher course.I am letting the graphs tell the storyPrimarily I have used the Data Warehouse to gather some initial data for our mental health chief and place the data into Excel for his review. I have also created new health factors for the ESI levels (Emergency Severity Index) which can now be pulled into reports for our local facility.Diversified trending for leadershipI am working on Identifying gaps in the software, tools, and knowledge of interested parties in order to develop an analytic strategy.I put in a plan of action to shorten the time spent on phone calls, by identifying the kind of calls that come into the call center that last more than 10 minutes. The result was no more calls lasting 30 or 45 minutes.Streamlined processes for extracting data at the Corporate Data Warehouse (CDW) that save an enormous amount of resources at the facility level.I applied the educational component in designing an AO academy addressing informatics components. Analysis of data, importing and exporting data, building reports and understanding standards are all addressed in the AO Academy.Simply, I like the information related to impactful presentations. When the story is missing and someone is presenting pure data such a dashboards, power points and technical jargon it is easy to lose your audience that cares for patients. When information can be brought down to how you would want to connect with health care provider with some useful data but not overlaod this gives a better chance at improvements and success.Interpreting Pyramid AnalyticsUsing stories to explain the dataImproved my reports to depict a better representation of the data (story)Dashboard for: Report of Outside Hospital Admissions per NVCC, hospital wide.created a dashboard for tracking 3rd yr to 1st yr handoffs in the continuity clinic.Use of flow charting to describe a processn/aPresentation (using the tips learned in class) after gathered and analyzed data. This presentation told the story of how using a printer in the specified way would not be efficient or cost effective. Nor would it solve the issue that the printers were even purchased for.Flow chartsI successfully constructed a line graph to compare falls data between last fiscal year and this one.querying CDW dataI have talked to the PACT nurses about their performance measures and the data related to their teams.Trending data telling a storyOne strategy that I have found helpful is the ability to identify the type of graphs needed for the situation at hand.Direct measurement of data; collation of data from a large data set.screening data warehouse to identify my panels high risk COPD patients that would benefit the most from shared medical appointments.Better data visualizationImprovement on my excel use.analysisOpioid SafetyBegan teaching frontline chiefs and administrative officers how to use Pyramid Analytics and how to do Data RepresentationAssistance with EPRP16510-506730Appendix B: Additional Documents00Appendix B: Additional DocumentsAttached below is the evaluation plan, Level 1/2 survey results, follow-up (Level 3) survey and Introduction to Health Care Data Analytics Syllabus that was developed for this program. ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download