DRR Final Evaluation Draft Report - Plan International
52597052260600020237451790700020955011938000Strengthening Disaster Risk Management and Capacities in Lao PDRFinal EvaluationFinal report6 March 2015Prepared byContents TOC \o "1-3" \u 1Acronyms PAGEREF _Toc413424190 \h 42Executive summary PAGEREF _Toc413424191 \h 53Project background PAGEREF _Toc413424192 \h 84Evaluation methodology PAGEREF _Toc413424193 \h 94.1Scope PAGEREF _Toc413424194 \h 94.2Final Evaluation activities PAGEREF _Toc413424195 \h 94.3Limitations and challenges PAGEREF _Toc413424196 \h 105Findings PAGEREF _Toc413424197 \h 125.1Impact and effectiveness PAGEREF _Toc413424198 \h 125.2Relevance PAGEREF _Toc413424199 \h 205.3Efficiency PAGEREF _Toc413424200 \h 215.4Sustainability PAGEREF _Toc413424201 \h 246Conclusions and recommendations PAGEREF _Toc413424202 \h 267Appendix A: Final Evaluation Survey Questionnaires PAGEREF _Toc413424203 \h 287.1Knowledge Attitude Practice (KAP) Household Questionnaire PAGEREF _Toc413424204 \h 287.2Key Informant Interview (KII) Questionnaire PAGEREF _Toc413424205 \h 338Appendix B: KAP Survey Report (Baseline versus Endline) PAGEREF _Toc413424206 \h 428.1Sample overview PAGEREF _Toc413424207 \h 428.2Knowledge and awareness PAGEREF _Toc413424208 \h 438.3Practices PAGEREF _Toc413424209 \h 45AcronymsCF Child FundDDMC District Disaster Management CommitteeDRM Disaster Risk ManagementDRR Disaster Risk ReductionHVCA Hazard Vulnerability and Capacity AnalysisKAP Knowledge Attitude and PracticeKIIKey Informant InterviewMOES Ministry of Education and SportMOLSW Ministry of Labour and Social WelfareMONRE Ministry of Natural Resources and EnvironmentMOU Memorandum of UnderstandingNDMP National Disaster Management PlanNDMO National Disaster Management OfficePDMC Provincial Disaster Management CommitteePVCA Participatory Vulnerability and Capacity AnalysisRDPENational Committee for Rural Development and Poverty EradicationRIES Research Institute for Education and SportSCI Save the ChildrenVDMC Village Disaster Management CommitteeExecutive summaryThis document is a Final Evaluation of the program “Strengthening Disaster Risk Management Systems and Capacities in Lao PDR”, which is part of the Disaster Preparedness and Response initiative of the Australian Government. The program was implemented in 82 villages across nine districts in four provinces during 2013 and 2014.The overall objective of the program was to strengthen the national disaster risk management capacity of Lao Government and communities through an integrated, multi-level approach to Disaster Risk Reduction and Disaster Risk Management capacity building, education and training.The activities of Save the Children, ChildFund and Plan International related to four program outcomes:Strengthened multi-level linkages for effective disaster risk reduction, preparedness and response at all levelsChildren and teachers have improved knowledge and understanding of risk and risk management options and skills in monitoring of risk management initiativesImproved School Disaster Management awareness and practicesAccess to schools and school infrastructure is safer and disaster resilient.The purpose of this Evaluation is to assess the extent to which the objective of this program has been realized and progress on the four outcomes has been achieved. The evaluation addresses questions grouped under four broad themes – impact and effectiveness; relevance; efficiency; and sustainability.The program was aligned closely with the strategies of the Government of Lao PDR including the strategies outlined in the Government’s Strategic Plan on Disaster Risk Management. It was also highly relevant to the needs of the communities targeted by the program, which are located in poor districts that are vulnerable to small-scale disasters. Consortium members have been successful in creating a sense of engagement with Government stakeholders (at all levels) and with the local communities themselves. All stakeholders recognized the importance of strengthening the capacity of communities and the Government to reduce the risks associated with small-scale disasters. The consortium approach contributed to the strength of program implementation in the target districts. The approach enabled the program to reach into four provinces with different hazard landscapes, in a way that would not have been possible with a single organization. There were clear benefits from sharing tools, experiences and lessons learned, as well as the enhanced influence with Government officials that a consortium approach brings. For example, having three organizations jointly implement the DRR curricula was more influential with education officials than if a single organization had done so. Overall, implementation of program activities was consistent with the design of the program. All program activities were implemented in full within the duration of the program. Key achievements of the program include: Relevant ministry officials at all levels of Government have increased their awareness and appreciation of disaster risk reduction and disaster risk managementDistrict/Village Disaster Management Committees and child clubs have been established and supported, and are operating effectivelyHazard assessments have been undertaken and Disaster Action Plans have been developed and rolled out in all target communitiesNew education modules and teacher support materials have been developed and rolled out to all target schoolsTeachers have received training in the new disaster risk reduction curriculum School infrastructure has been made safer and more disaster resilient through the small grants component of the program.The program has had a positive impact on the knowledge, attitudes and practices of the target communities. Based on the household surveys and key informant interviews, interviews with consortium staff and Government officials at the national level, and a review of program documentation, the evidence strongly suggests that the program led to a substantial increase in knowledge and awareness about the hazards faced by the communities and how to reduce or mitigate the associated risks. This increase in knowledge and awareness has been achieved across different population groups in the community, namely children, youth, adults, teachers and local administrators.There is also evidence to suggest that the program has been successful in changing behaviours and practices relating to disaster risk reduction and disaster risk management. For example, communities now have greater access to, and make greater use of, early warnings systems. Communities have identified hazards relating to unsafe school buildings and infrastructure, and have made improvements to create safer school environments. Communities have also participated in evacuation drills and emergency simulations. Taken together, these changes in behaviours and practices have improved communities’ preparedness for, and resilience to, the small-scale disasters they face on a regular basis. However, perhaps not surprisingly given the short duration of the program, there remains considerable scope for further improvement in behaviours, practices and outcomes in the target communities. In particular, based on the endline survey results, children’s knowledge of how to help disabled people in the event of an emergency has improved but remains quite low. The endline survey results also suggest there is scope to improve communities’ knowledge of standard operating procedures for safety in the event of emergencies. The program was structured with a view to sustaining the benefits of the program over the long term. This is reflected in the emphasis on capacity-building for Disaster Management Committees and child clubs, the new curricula and teacher support materials for rollout in all schools, and the multi-level, community-wide approach to disaster risk management. Nevertheless, there are limitations regarding the sustainability of the achievements made through the program. First, it is difficult to reinforce newly-acquired knowledge, support new institutional structures, and create long-lasting changes in practices and attitudes within a two-year program. Second, while the development and rollout of new school curriculum and training provided to teachers was successful, it remains to be seen whether the benefits of the new curriculum for Grades 3-6 will stay with the students as they progress through higher grades. It also remains to be seen whether the new curriculum can be sustained in a limited number of schools and districts, in the event that funding is not secured to implement the Government’s commitment to a national rollout of DDR curriculum.These limitations reflect the short duration of the program. While program funding was initially obtained for two years, the program was designed in the expectation that subsequent funding would be obtained for two additional years – which did not eventuate. This explains why some elements of program design – such as having a consortium approach, implementing the small grants component in year 2 and rolling out the DRR curriculum in the second half of year 2 – would be more appropriate in a four-year program rather than a two-year program.Aside from this issue, the program was well designed and implemented, and achieved positive results on the key program objective and outcomes. The lessons learned in the design and implementation of this program will provide a solid foundation for future programs that address the important issue of disaster risk reduction in Lao PDR.This evaluation presents six recommendations with a view to improving programming in this area in the future.A consortium approach to program implementation should be encouraged, particularly where each member brings different but complementary capabilities to the consortium and where adequate resources are allocated to consortium management activities.Reflecting the good practice of this program, future programs should be designed carefully to align with Government priorities and strategies in this area. Programs that seek to achieve lasting improvement in attitudes, behaviours and practices in the area of disaster risk management should ideally be implemented over a period longer than two years. Those involved in program design and implementation need to keep striving for new and improved ways to make programs more inclusive of the needs of vulnerable groups, particularly people with disabilities as well as women and girls. Future DRR programming should build on this program’s successful development of curricula, teacher training and support materials, with consideration given to developing new modules for higher school grades (beyond grade 6). Donors and other organizations should continue to advocate for DRR modules to be mainstreamed in the national school curricula, in recognition of the sustainability challenges of rolling out DRR modules in a limited number of target schools.Project backgroundConsulting firm Emerging Market Consulting (EMC) has been hired to conduct a Final Evaluation of the program “Strengthening Disaster Risk Management Systems and Capacities in Lao PDR”, which is part of the Disaster Preparedness and Response initiative of the Australian Government.The program was implemented over two years (January 2013 to December 2014) by a consortium comprising Save the Children (SCI), ChildFund (CF), Plan International and World Food Program. This Final Evaluation relates to the activities of SCI, CF and Plan. The program was implemented in 82 villages across nine districts in four provinces:Luang Prabang: 30 villages in three districts (SCI) Bolikhamxay: 30 villages in three districts (SCI)Xieng Khouang: 12 villages in one district (CF)Bokeo: 10 villages in two districts (Plan).The overall objective of the program was to strengthen the national disaster risk management capacity of Lao Government and communities through an integrated, multi-level approach to Disaster Risk Reduction and Disaster Risk Management capacity building, education and training.The activities of SCI, CF and Plan related to four program outcomes (labeled as outcomes 3 to 6 of the program):Strengthened multi-level linkages for effective disaster risk reduction, preparedness and response at all levelsChildren and teachers have improved knowledge and understanding of risk and risk management options and skills in monitoring of risk management initiativesImproved School Disaster Management awareness and practicesAccess to schools and school infrastructure is safer and disaster resilient.Evaluation methodologyScopeThe purpose of this Final Evaluation is to assess the extent to which the objective of this program has been realized and progress on the four outcomes has been achieved. The evaluation addresses questions grouped under four broad themes:Impact and effectiveness:To what extent have the overall objective and expected outcomes been achieved?Were the program activities and outputs consistent with the intended effects and ultimate impact of the project?Relevance:To what extent did the program objective remain relevant and consistent with beneficiary needs and priorities, relevant Government of Lao PDR policies, and the overall operating environment? Efficiency:What factors acted as enablers or constraints to the achievement of the program objectives? How economically were program resources/inputs (funds, expertise, time, etc.) used to achieve the desired results?Sustainability:What is the likelihood of program benefits being sustained beyond the program period? What are the potential long-term effects of this program, positive and negative, intended or unintended?Final Evaluation activitiesThis Final Evaluation is based on analysis of information collected through a mix of desk research, household surveys, and in-depth interviews with relevant stakeholders (consortium staff and Government officials at the national level).EMC undertook a desk review of relevant policies, strategies and other documents of the Government of Lao PDR, as well as program documents from consortium members that included project design documents, baseline data and report, monitoring and evaluation data, progress reports, and workshop reports.A key component of the evaluation was the endline Knowledge Attitude and Practice (KAP) survey of 347 households and 92 Key Informant Interviews (KIIs) that EMC conducted in the four provinces in December 2014. In consultation with consortium members, EMC developed a sampling strategy for the KAP survey and KIIs that closely resembled the sampling conducted in the baseline research conducted in February-March 2013. The two samples are broadly comparable in terms of type and number of persons surveyed in each village. (See Appendix B: KAP Survey Report for details of the baseline and endline samples.)EMC, in consultation with consortium members, refined the KAP and KII survey tools used in the baseline so as to capture all relevant information to meet the needs of the Final Evaluation. EMC, with support from SCI, conducted one day of training for the two team leaders and four enumerators. The two research teams implemented the KAP survey and KIIs in 12 villages from five districts in four provinces, according to the schedule outlined in REF _Ref410656326 \h Table 1. In total, endline data was collected from 347 households for the KAP survey and 92 key informants (including community leaders, school principals, teachers, local government officials and consortium program staff).Table SEQ Table \* ARABIC 1: Data collection for endline KAP survey and KIIsDateProvinceDistrictVillages8-9 Dec 2014BolikhamxayViengthongPhondou, Thadeua8-9 Dec 2014Luang PrabangViengkhamHouykuang, Houy Chok12-16 Dec 2014XiengkhouangNonghetNonghet Tai, Paka, Dindam, Phakhae Neua12-16 Dec 2014BokeoMeungTorle, Ponghine, ThamphabathPakthaDonesavanhIn addition, EMC conducted interviews with national program staff at SCI, CF and Plan, as well as national representatives of: Ministry of Education and Sport (MOES); Ministry of Labour and Social Welfare (MOLSW); and National Committee for Rural Development and Poverty Eradication (RDPE). EMC presented preliminary findings of the survey results to national consortium members in January 2015, which generated valuable feedback that was incorporated into the draft report.Limitations and challengesThe research team did not encounter any unanticipated challenges during the data collection phase. The team benefited from the insights shared by consortium members regarding baseline survey implementation challenges, as well as from the logistical support of consortium district staff. As expected, there were some communication challenges that resulted from some survey participants not speaking the Lao language, but these interviews were successfully completed with the assistance of translators.There were two main challenges in comparing results from the baseline and endline surveys.First, in the endline survey, it was not possible to survey the same villages in Bokeo Province as had been surveyed in the baseline survey. At the time of the baseline survey, Plan International had not finalized the villages to be targeted in the program. As it turned out, the four villages surveyed in the baseline were not included as target villages for program implementation. Consequently, Plan International recommended four other villages to be sampled in the endline, which introduces the possibility of selection bias. Second, it is possible that the same questions in the baseline and endline surveys may have been asked with different levels of explanation or prompting. The baseline survey was conducted by Ms. Phoukham Sipaseuth using a survey team that included provincial and district officials from the Ministry of Labour and Social Welfare (MOLSW) and the Ministry of Education, Youth and Sport (MOEYS). The endline survey was conducted by consulting firm EMC using a team of experienced survey enumerators. Consistent with the training provided by EMC, endline enumerators provided additional explanation of questions in cases where the participant appeared not to understand the question. However, it is not clear whether a similar technique was employed in the baseline questioning, since the baseline questionnaire instructed enumerators to record answers “without probing”. The very high “no response” rate for many questions in the baseline suggests that enumerators may not have fully explained questions that at first instance were not understood by participants. As a result, some of the difference in responses between the baseline and endline surveys may reflect, in part, possible differences in interviewing techniques. EMC was unable to isolate this effect when analysing the results.FindingsImpact and effectivenessTo what extent have the overall objectives and expected outcomes of the program been achieved?Were the program activities and outputs consistent with the intended effects and ultimate impact of the project?The overall objective of the program was to strengthen the national disaster risk management capacity of Lao Government and communities through an integrated, multi-level approach to Disaster Risk Reduction (DRR) and Disaster Risk Management (DRM) capacity building, education and training.Below, the extent to which each of the four program outcomes (3 to 6) has been achieved is evaluated.Outcome 3: Strengthened multi-level linkages for effective disaster risk reduction, preparedness and response at all levelsThe main activities designed to achieve this outcome were:To establish and support 132 VDMCs and 15 DDMCs in the target communitiesTo train and build the capacity of committee members to improve their awareness and understanding of DRR and of their roles and responsibilities as committee membersTo support VDMCs to conduct Hazard, Vulnerability and Capacity Assessments (HVCA) and develop DRR Action Plans for their communities.To establish community-based early warning systemsThe program achieved its activity targets in terms of establishing, supporting and training VDMCs and DDMCs, conducting HVCAs, and developing DRR Action Plans at the village level. As an example of the training provided to DMCs, in May 2013 SCI organized DRR training of trainers sessions for provincial and district DMCs in Bolikhamxay, so that they could roll out the training at the village level. After two days of training, post-evaluation surveys showed that 79% of participants could correctly define key DRR concepts.One challenge experienced by consortium members in undertaking training and other program activities was the difficulty of accessing some villages during the rainy season. This was noted as a constraint or limitation in the minutes of the Final Workshop for both Bolikhamxay and Bokeo. Another challenge raised in an interview with CF was that some activities coincided with the harvest season, which made it difficult for villagers to attend.According to monitoring data on Early Warning Systems (EWS) that were provided to 29 villages in Bolikhamxay and 17 villages in Luang Prabang, the system was functioning in 71% of the villages. Of the remaining systems, 7% had broken and were being repaired, while 22% had not been installed due to a lack of electricity in the village. The systems that are functioning are being used regularly (usually at least three times per month) to announce warnings as well as for other important village announcements.In total, 85% of endline KII respondents said their organization or community set up an early warning system, with the most common systems being loudspeakers (70%) and telephone messages (20%). When asked the same question in the baseline KII, only 7% of respondents answered in the affirmative.In the endline KAP survey, when participants were asked how the community helped to reduce the risk or impact of any hazards experienced in the past two years, by far the most common responses were early warning systems and loudspeakers (51% of respondents).More generally, 88% of KII respondents believe there is evidence that Government or village level structures have adopted practices and attitudes resulting from the program. For example, one DMC member drew attention to the “evaluation of natural hazard risk in the community” as a key aspect of the program.The program strengthened multi-level linkages in various ways. For example, child clubs coordinated with DMCs at the district and village levels to undertake and present hazard assessments. Teachers were provided with guidance in engaging both the VDMCs and children to assist with the DRR action planning following the completion of the hazard assessments. VDMC representatives assisted the children with addressing the issues and developing potential solutions.Outcome 4: Children and teachers have improved knowledge and understanding of risk and risk management options and skills in monitoring of risk management initiativesThe main activities relating to outcome 4 are presented in the table below, along with the percentage of all 92 KII respondents who agreed or strongly agreed that these activities had been undertaken.Table SEQ Table \* ARABIC 2: Outcome 4 activities and achievementActivity% of KII respondents agree or strongly agreeNew DRR curriculum modules were developed by the consortium in 2013, pilot-tested in the first half of 2014, and rolled out to all target schools in the second half of 201492%New DRR teacher support materials were produced, including teacher guidelines and school-based hazard risk mapping guidelines 90%Children and teachers were trained to conduct child-friendly hazard assessments (HVCAs) in the school and surrounding community79%Small scale activities were implemented based on the priorities identified in the DRR Action Plans93%In interviews conducted in September 2014 by SCI staff with principals and teachers from 60 target schools in Luang Prabang and Bolikamxai, 68% of interviewees agreed that most teachers had received training about hazards and risk reduction, with another 29% agreeing “somewhat” and 3% saying “no”. When asked if most students are aware of things that can be done to reduce risks in the home, school and community, 35% of interviewees agreed, 37% agreed “somewhat” and 28% said “no”.In interviews with consortium members and education officials at the national level, the general consensus was that the new curriculum was very useful and that both teachers and students enjoyed the new participatory teaching style. According to one national consortium member, “Teachers said they had never thought to use songs in the classroom before.” A quarterly report from another consortium member observes that: “Based on our monitoring students’ participation in DRR activities, school students’ understanding in DRR has been improved resulting from teachers’ introduction to the teaching guide book and using participatory methods … It is also expected that this information can be shared among teachers across the schools so that they also … continuously apply this in their teaching on other subjects.” Results from the baseline and endline KAPs support the finding that during the life of the program, children have received additional information about hazards from their school. In the endline survey, 92% of children said they had learned about hazards at school. By comparison, in the baseline survey, only 39% of children said they had learned something at school about reducing the impact of floods. (No details were provided.)More broadly, the results from the endline KAP survey and KIIs with the 25 teachers indicate that the program achieved this outcome, with significant increases in knowledge and understanding about hazards and risk reduction. Given that the new curriculum modules were only rolled out towards the end of the two-year program, the increase is likely to have come from other program activities that commenced in the first year of the program, including hazard assessments, activities, songs and key messages. In the endline KAP survey, all 120 children and 38 of the 39 youth in school (97%) were able to nominate at least one hazard (average of 2.5 to 3 hazards) that their community faced. By comparison, in the baseline KAP survey, only 6 of the 112 children (5%) nominated a hazard, with another 6 children saying their community faced no hazards and the remaining 100 children not providing a response to the question. (As mentioned earlier, the high “no response” rate suggests that baseline enumerators may not have elaborated on questions in cases where the participant did not understand the question. However, EMC is not able to confirm precisely how the questions were asked in the baseline.) Similarly, in the endline KII, all 25 principals and teachers nominated at least one hazard (average of 4 hazards) that their community faced, while none of the 12 principals and teachers interviewed in the baseline KII provided a response to the question. (Again, it is difficult to interpret the high “no response” result in the baseline.)While it is possible that the dramatic increase in response rates from baseline to endline may partly reflect different levels of explanation or prompting in the way the question was asked, it is likely to also reflect a genuine increase in knowledge and conceptual understanding about what constitutes a hazard. Based on the observations of consortium members, prior to this program, members of these communities did not view the small-scale disasters that affected them within the conceptual framework of hazard identification, disaster preparedness and disaster mitigation. In the endline KAP, 92% of children said they learned about these hazards at school, with the other main sources of information being at home (42%), from NGOs (42%) and personal experience (29%). The corresponding figures for youth in school were 41% at school, 23% at home, 33% from NGOs and 28% from personal experience. In the KII, 68% of principals and teachers got their information from NGOs, while 56% also used government sources. In the endline KAP and KII, 67% of children, 87% of youth in school, and 96% of principals and teachers believe their preparedness for hazards has increased in the last two years, with most other respondents indicating no change in their level of preparedness.In conclusion, the DRR curriculum and teaching support materials developed under the program, along with other DDR school-based activities, appear to have been well received by both teachers and students. Based on endline survey results, project monitoring reports and interviews with stakeholders, it appears that many students have enhanced their knowledge and awareness of hazards and risk reduction as a result of the program, although a significant percentage of students are perceived – by themselves and also by teachers – to have experienced little or no improvement. Given the short duration of the program, it is likely that the full benefits of the program (in terms of improved knowledge and awareness) will only become apparent in the months and years ahead. Outcome 5: Improved School Disaster Management awareness and practicesThe main activities relating to outcome 5 are presented in the table below, along with the percentage of all 92 KII respondents who agreed or strongly agreed that these activities had been undertaken.Table SEQ Table \* ARABIC 3: Outcome 5 activities and achievementActivity% of KII respondents agree or strongly agreePractice simulation drills for expected and recurring disasters were undertaken, incorporating the needs of children with disabilities; Standing Operating Procedures (SOPs) and Guidelines for these school drills were developed88%School administrators, staff, and students engaged in on-going school community DRM activities, including hazard and risk assessments 93%School DRM plans were developed that incorporated the needs of children with disabilities89%School DRM plans were linked with VDMC disaster planning, to encourage a community-wide approach to disaster management planning92%In terms of perceived impact, the majority of all 347 respondents in the endline KAP survey believe there has been a significant improvement in their school disaster management awareness and practices over the past two years. In total, 75% of children, 74% of youth in school, 69% of youth out of school and 88% of village adults believe there has been a “big improvement” or “improvement” compared to two years ago. The biggest perceived improvement was in on-going disaster risk reduction and preparedness planning at schools (78% of all KAP respondents), while the lowest improvement was increased knowledge of standard operating procedures for safety in the event of emergencies (44%) and educational continuity planning at schools (45%). The relatively low score for improved knowledge of standard operating procedures is echoed in results from interviews conducted in September 2014 by SCI staff with principals and teachers from 60 schools in Luang Prabang and Bolikamxai. In those interviews, 55% felt that most students are not familiar with safe building evacuation procedures for fire, 48% felt that most students are not familiar with safe assembly areas, and 67% felt that most students are not familiar with safe family reunification procedures.On a more positive note, CF felt that the emergency simulations conducted in its target districts had been successful in improving communities’ disaster preparedness. For example, CF reported that the Nonghet emergency simulation on fire “built on overall capacities of DDMC and communities who participated in the event” and “also provided ideas for the district government to start initiating planned simulations in their district strategy”. Outcome 6: Access to schools and school infrastructure is safer and disaster resilientThe main activities relating to outcome 6 are presented in the table below, along with the percentage of all 92 KII respondents who agreed or strongly agreed that these activities had been undertaken.Table SEQ Table \* ARABIC 4: Outcome 6 activities and achievementActivity% of KII respondents agree or strongly agreeSchool Development Plans were reviewed to incorporate appropriate hazard mitigation89%Training was conducted on infrastructure DRR activity planning for stakeholders87%Schools undertook structural and non-structural hazard protection measures through the small grants program92%These KII results support other evidence that considerable work has gone towards making schools safer. For example, in interviews in September 2014 with 30 schools in Bolikhamxay: 87% of schools indicated they were incorporating DRR in school development plans; 100% of schools said that school buildings and grounds are maintained and repaired for disaster resilience; and 83% of schools said that school infrastructure (including access routes, shelters and safe evacuation points) are developed as needed and maintained for safety.A national representative from CF indicated that implementation of the small grants component of the program had been challenging in several respects. The process for approving grant applications took longer than anticipated. Second, in some villages, community contributions of labour for small grant activities were lower than anticipated due to their engagement in the corn-harvesting season. While these challenges resulted in some delays, the small grants component was still fully implemented.In addition to making schools safer, it appears that safety improvements made using the small grants component also had a positive impact on school attendance. In a monitoring report conducted in Luang Prabang, average absence rates had fallen from 20-30% to 0-10% in some schools – especially those that had improved the safety of school access/entry and water/sanitation facilities. This supports the view that key drivers of absenteeism include difficult access to schools (especially in the rainy season), inadequate toilet facilities (especially for girls) and inadequate hand-washing facilities (which contribute to diarrhoeal diseases).In terms of outcomes, 89% of all KAP respondents agreed or strongly agreed that access to schools and school infrastructure is safer and more disaster resilient compared to two years ago. The most common measure was the use of hazard-resistant techniques in construction and retrofit (47% of respondents). Other measures included building a fence around the school (to protect against animals roaming on school grounds and/or children wandering onto nearby roads), “improving” the school building, having an evacuation plan and having the soil tested. Cross-cutting issues: gender and disabilityThe program explicitly recognized that the key to successful inclusion of the most vulnerable populations – including women and girls and persons with disabilities – in DRR and DRM is ensuring their meaningful participation, active involvement and effective representation in all stages of planning, preparation and implementation at all levels.Gender:Increasing the participation of women and girls – in VDMCs, child clubs and training activities – was a focus for the program. Each consortium member had targets for female representation on VDMCs, although in some cases it was challenging to meet targets due to cultural factors as well as the low number of women in Government positions in some areas. For example, CF indicated that it was a challenge to achieve its modest target of having one woman on each VDMC, due to cultural factors in ethnic minority villages. On a more positive note, SCI found that promoting leadership positions for girls in child clubs was an effective way to give girls a voice in disaster risk management. People with disabilities:The program also sought to be inclusive of people with disabilities, ensuring they were involved in risk assessments, hazard mapping and other DRR activities (including simulation drills), and contributing to the design of community preparedness plans that took into consideration the needs of differently abled members of the community. For example, SCI arranged specific outreach groups which were able to attract children with cognitive and physical disabilities both in and out of school. The risk mapping was done using various methodologies including hazard awareness through pictorial depictions, language, body movements and writing.Knowledge about helping persons with disabilities to deal with hazards appears to have been quite low prior to commencement of the program. According to the baseline results, only 23% of KAP respondents said they knew a person with a disability and agreed there are things that can be done to make them safe. When asked what things can be done to help them, only 6% of KAP respondents were able to provide a suggestion (4% children, 11% youth and 6% adults), with the only suggestion being to help move the person to a safer place. The endline results indicate that community members are now more aware of how to help persons with disabilities, although awareness levels are still quite low. When asked how they could assist disabled persons, 46% of KAP respondents provided at least one suggestion (33% children, 41% youth in school, 46% youth out of school and 61% adults), with the three main suggestions being evacuation/transportation, alert the person, and education programs. Among the 92 KII respondents, 63% provided a suggestion on how to help. In addition, 65% of KAP respondents agreed that their community DRR Action Plan addresses the needs of people with disabilities (compared to 80-93% of respondents who felt their plan addresses the needs of other groups – men, women, boys, girls, youth and minority groups). In the KII survey, 75% of respondents felt that the program covers the needs of people with disabilities. (The 25% who disagreed were not asked to elaborate.)In interviews with Government officials at the national level, officials did not seem to have a clear idea of how the program addressed the issues of gender and people with disabilities. Education officials indicated that gender was incorporated into the curriculum by ensuring an equal number of boys and girls were represented in textbook pictures, and that disability was covered elsewhere in the curriculum. MLSW officials indicated that gender and disability were incorporated into the program, but they did not provide any examples of how this had been done.Encouragingly, in interviews conducted in September 2014 by SCI staff with principals and teachers from 60 target schools in Luang Prabang and Bolikamxai, 82% felt that the needs of young children, girls, and persons with disabilities had been integrated into training and awareness, with another 14% saying that needs had been “somewhat” integrated. Other commentsOverall, the consortium members, government officials and the communities themselves seem to have a positive impression of the need for, and success of, the program. For example, 86% of the 92 KII respondents agreed or strongly agreed that the program succeeded in achieving its objective, namely to strengthen the national disaster risk management capacity of Lao Government and communities through an integrated, multi-level approach to DRR and DRM capacity building, education and training.In the household KAP surveys, the significant increase in perceived knowledge and awareness of hazards and disaster risk management practices (as reported earlier) is an important indicator of the effectiveness of the program. In terms of how this knowledge translates into improved practices, when asked how they responded to or prepared for hazards they have faced in the past two years, 66% of KAP participants provided at least one activity, with the most common responses being reunification plans (20%) and practice evaluation drills (19%). Of the other participants, 2% said they did nothing and 32% said they didn’t know. When KII participants were asked the same question, 77% provided at least one activity, while 23% said they didn’t know.Taken together, these results suggest that the program has made some important inroads in terms of improving knowledge and – to a lesser extent – changing practices, while recognizing the challenges of trying to achieve systemic change in practices and behaviours during the course of a two-year program.It is important to note that while program funding was initially obtained for two years, the program was designed in the expectation that subsequent funding would be obtained for an additional two years – which did not eventuate. This explains why some elements of program design – such as having a consortium approach, implementing the small grants component in year 2 and rolling out the DRR curriculum in the second half of year 2 – would be more appropriate in a four-year program rather than a two-year program.RelevanceTo what extent did the program objective remain relevant and consistent with beneficiary needs and priorities, relevant Government of Lao PDR policies, and the overall operating environment? The program objective and expected outcomes are directly supportive of the policies and strategies of the Government of Lao PDR, including the strategies outlined in the Government’s Strategic Plan on Disaster Risk Management, namely to:Safeguard sustainable development and reduce the damage of natural or manmade disastersShift the focus of Government agencies from disaster relief to disaster preparedness and mitigationDevelop community-based disaster management approaches. More broadly, the program supports the achievement of the Hyogo Framework for Action, with particular focus on three of the five priorities:Ensuring that DRR is a national and local priority with a strong institutional basis for implementationUsing education to build a culture of safetyReducing underlying risk through village level assessments.At the local level, 91 of the 92 respondents in the endline KII believed that the goal of the program matched the strategy of the Government. When asked if the project had contributed to the implementation of the National Disaster Management Strategy, 53% of KII participants agreed. Typical comments were that “the program follows the same strategy as the Government strategy” and that the consortium members were “participating with the Government to help the community”. On the other hand, 32% of KII participants felt that the program did not match the Government strategy, with common responses being a perceived need to modify the selection of target villages, a general lack of project funding or support, and a few comments to the effect that the project or procedures were “not in line” with the target of the Government (although these respondents did not elaborate on which targets they were referring to). Concerns about the selection of target villages is surprising, given that the target districts and villages were carefully selected based on factors including their hazard vulnerability and poverty profile, as well as consultations at district and village level. Of the nine selected districts, eight are identified by the Government as among the poorest 47 districts in Lao PDR (designed “high priority” districts), with the other district identified as among the next 25 poorest districts (“priority” districts). Moreover, one of the target provinces (Luang Prabang) is a key priority province for the NDMO, with over 76 per cent of its villages classified as poor and vulnerable to disasters.Officials from MOEYS at the national level raised the issue of reconciling the implementation a new school curriculum in a small number of target villages with the ministry’s broader responsibility to provide a consistent national curriculum in all schools throughout the country. Ministry officials expressed interest in a national level roll-out of the new curriculum and the ministry is currently working on incorporating DRR mainstreaming into the Education Sector Development Plan 2016-2020. (This issue is explored in further detail in section 5.4.) A national roll-out – or a roll-out to high-risk provinces – would also encounter the challenge of making the curriculum relevant to the hazards faced by each province while maintaining a consistent national curriculum in all schools throughout the country. In terms of meeting beneficiary needs and priorities, communities across Lao PDR are affected by frequent small-scale, recurrent disasters, which have significant socioeconomic impacts. Within this context, the program was implemented in districts that are vulnerable to, or have a history of experiencing, hazards or disasters. In total, 66% of KAP respondents (including 80% of adults and 46% of children) indicated they had experienced a hazard within the past two years, with the most common hazards being floods, landslides and strong winds. Similarly, 68% of KII respondents indicated they had experienced a hazard over that time. The most common impacts of these hazards were loss of income, psychosocial impacts, the death of animals and damage to crops. In interviews with consortium members and Government officials at the national level, all persons interviewed were strongly of the view that the program served a genuine need in the target communities, and that provincial and district administrators, as well as the communities themselves, are keen to continue working to enhance their preparedness and response to disasters. While the program remained relevant and consistent with the overall operating environment, implementation was affected by a 2011 Prime Minister resolution – which came into effect in 2013 – which transferred oversight of the National Disaster Management Office (NDMO) from the Ministry of Labour and Social Welfare (MLSW) to the Ministry of Natural Resources and Environment (MNRE). This meant there was a delay in getting MoUs signed for SCI. While SCI was able to continue to conduct activities at the field level without an MoU, the situation resulted in an increase in workload for the field teams (to ensure activity level approval by the provincial Government) and led to some delays in procurement of large items such as cars and furniture.EfficiencyWhat factors acted as enablers or constraints to the achievement of the program objectives?TimeA key constraint to the achievement of the program objectives was the relatively short duration of the program of two years. It is very difficult to achieve and sustain changes in behaviour and practices – particularly in relation to a new concept for a community such as disaster risk management – in only two years. For example, the new school curricula was developed in the first year of the program, piloted and refined in the first half of the second year of the program, and only fully rolled out towards the end of the program. While it is hoped that education officials and teachers have received sufficient training for them to implement the new curricula and sustain its implementation, the program finished before there was time to monitor the effectiveness of the rollout or to measure its impact on the knowledge and skills of students who received instruction in the new curricula.Similarly, the small grants component for improving school infrastructure was implemented in the second year of the program – consistent with the implementation schedule. By the time grants were assessed and approved – which according to CF took longer than anticipated – and by the time the infrastructure upgrades were carried out, there was little time left to monitor the effectiveness with which the resources had been spent, the impact of these upgrades on improvements in school safety, and support to ensure the infrastructure improvements are effectively maintained. (It should be noted that consortium members had in place an M&E framework for the grants component which included technical checks of the work carried out.) As mentioned earlier, the program was designed in the expectation that funding would be extended for years 3 and 4, in which case having infrastructure upgrades in year 2 would have been a more natural fit.In interviews with national consortium staff and relevant Government officials, the short duration of the program was repeatedly mentioned as a key constraint to achieving and sustaining the program objectives. Interestingly, 73% of the 85 KII respondents who answered the question said that “time” was an enabler, rather than a constraint. It is difficult to reconcile this result with the fact that the program ran for only two years.Finances and resourcesThe program appears to have been adequately resourced, in terms of sufficient funds for development and supply of education tools and materials, and administration of the small grants component of the program. Nevertheless, 79% of the 85 KII respondents who answered the question said that finance was a constraint on the program. (Finance is often raised as a constraint in such surveys.)The more significant resourcing constraint related to human resources. The program provided limited resources for activities relating to consortium management. A consortium manager position was funded for six months of the two-year program, with that person continuing to perform consortium management duties – including the joint monitoring and evaluation framework, joint workshops, and quarterly consortium steering group meetings – throughout the program, in addition to their program duties. This placed an added burden on some staff.Consortium approach to program implementationOverall, having the program implemented by a consortium of NGOs was an enabler to the success of the program. By bringing the organizations together, it enabled the program to reach into four provinces with different hazard landscapes, in a way that would not have been possible with a single organization. National consortium staff spoke very positively about the benefits from sharing tools, experiences and lessons learned, as well as the enhanced influence with Government officials that a consortium approach brings. Different members of the consortium were able to benefit from the expertise of other consortium members, which contributed to the effectiveness of program implementation in the target districts.Ministerial transfer of disaster management responsibilities As mentioned earlier, the program was affected by a 2011 Prime Minister resolution – which came into effect in 2013 – which transferred oversight of the National Disaster Management Office (NDMO) from the Ministry of Labour and Social Welfare (MLSW) to the Ministry of Natural Resources and Environment (MNRE). This presented a number of challenges for the program, including delays in getting MoUs signed, a loss of some of the benefits of DRR training for MLSW officials at the national level, and a change in leadership of the DMCs. Indications from national consortium staff and relevant Government officials suggest that these challenges were manageable and were not a major constraint on achieving the program objectives.How economically were program resources/inputs (funds, expertise, time) used to achieve the desired results?In the KIIs, participants were asked whether there were any obvious areas of waste or inefficiency. Only 13 respondents (14%) felt that there were areas of waste or inefficiency, although the examples they gave (lack of budget and lack of knowledge) are not directly related to efficiency of resource use.In interviews with consortium members and Government officials at the national level, interviewees did not identify any areas of waste or inefficiency. The general feeling was that resources had been used efficiently, and that the program had benefited from the pooling of resources among consortium members in terms of tools development and knowledge sharing.As mentioned earlier, the small grants component of the program was monitored through on-site technical checks to make sure the work had been completed to a satisfactory standard.SustainabilityWhat is the likelihood of program benefits being sustained beyond the program period? What are the potential long-term effects of this program, positive and negative, intended or unintended?The program was structured with a view to sustaining the benefits of the program beyond the life of the program, including the emphasis on establishing DMCs and child clubs, building the capacity of DMC members, developing new curricula and teacher support materials for rollout in all schools, and encouraging a multi-level, community-wide approach to disaster risk management.Encouragingly, 88% of KII respondents believe there is evidence that Government or village level structures have adopted new attitudes and practices resulting from the program – although few details were provided by the respondents as to what that evidence may be. One indication that new attitudes and practices have been incorporated into Government or village structures is in the high percentage of KII respondents who agreed or strongly agreed with the following statements:Children and youth are taking a leading role and are advocating for action on DRR and adaptation in their communities (91%)School administrators, staff and students are engaged in on-going school community DRM activities (93%)School DRM practices are linked with VDMC planning (92%).These encouraging results provide some hope that these attitudes and practices can be sustained.Also encouraging was the view expressed by Government officials at the national level that the program has contributed to greater awareness within Ministries of disaster risk management. This greater awareness may help to mainstream disaster risk management in policy development and implementation.However, as mentioned earlier, the limited duration of the program (two years) has major implications for the sustainability of the achievements of the program. Two years is not a sufficient amount of time to raise knowledge and awareness, and to institutionalize changes in attitudes and practices. This applies to the DMCs, child clubs, other village structures and the education system. The DDMCs and VDMCs are likely to require ongoing assistance, support and training to ensure they continue to carry out their roles and responsibilities effectively and continue to incorporate child clubs and other community structures into disaster risk management practices. As noted in a project quarterly report from one of the consortium members, “Training evaluation has found that refresher trainings will be an essential component to solidify knowledge and capacity in the VDMCs to ensure sustainability of the program past 2015.” Such refresher trainings would likely be necessary beyond the life of a two-year program.In relation to the new school curriculum, sustainability is problematic not only due to the two-year duration of the program (which limits monitoring of the rollout and impact) but also to the focus on curriculum changes for Grades 3 to 6 only. Education officials at the national level felt that for children’s DRR knowledge to be sustained, the key messages need to be reinforced and built upon every year – including beyond Grade 6. They also felt that extending the DRR curriculum to higher grades would enable some topics to be covered in greater depth. Moreover, having these modules taught in a relatively small number of schools and districts may pose challenges to sustainability, as there is a risk that over time the curriculum gets folded back into the standard national curriculum. Prospects for sustainability would be greater if the education system was to mainstream DRR into the national curricula.Encouragingly, there is institutional commitment to integrate DRR modules into the national curricula. The 5year disaster management strategy of MOES aims for 100% rollout of DRR curricula by the end of 2020, and the ministry is currently working on incorporating DRR mainstreaming into the Education Sector Development Plan (ESDP) 2016-2020 – which would embed it in the national strategy. The program has been instrumental in moving DRR curricula mainstreaming onto the national agenda, which is an important achievement. Although there is approval for a national rollout of DRR curricula, funding for such a rollout is yet to be confirmed. As noted in a report of the National Disaster Management Office, “The requirement for the new DRR education curriculum … to be delivered to all schools nationally requires serious commitment to funding, manpower and resources.” Getting this issue into the EDSP 2016-2020 would be an important step forward in this regard, since international donors will base their funding decisions for the sector on this document. While the institutional commitment to integrate DRR into the national curricula is a very positive step, the lack of committed funding casts some doubt as to whether this can be achieved by 2020. Consequently, the extent to which curriculum changes made in schools in a small number of villages or districts can be sustained in the event of significant delays to DRR being mainstreamed in the national curriculum is an important consideration that should be explored carefully in the design of future projects. Encouragingly, consortium members reported that both teachers and children had responded very positively to the participatory teaching approach used for the DRR modules, which involves experiential learning and incorporates songs, games and activities into the learning process. It is hoped that school administrators and teachers see the potential benefits of such a participatory approach and that teachers may be able to apply some of these modern teaching techniques to other parts of the school curriculum. When asked about the likelihood of such techniques being applied to other subjects, education officials at the national level said they hoped this could happen but that such application would be limited by the lack of participatory tools and materials developed for those other subjects. Conclusions and recommendationsOverall, the program was designed, managed and implemented effectively. The main objective of the program – to strengthen the national disaster risk management capacity of Lao Government and communities through an integrated, multi-level approach to DRR and DRM capacity building, education and training – appears to have been achieved. Key achievements include:Relevant ministry officials at all levels of Government have increased their awareness and appreciation of DDR and DRMDDMCs, VDMCs and child clubs have been established and supported, and are operating effectivelyHVCAs have been undertaken and Disaster Action Plans have been developed and rolled out in all target communitiesNew education modules and teacher support materials have been developed and rolled out to all target schoolsTeachers have received training in the new DDR curriculum School infrastructure has been made safer and more disaster resilient through the small grants component of the parison of the baseline and endline KAP and KII results strongly supports the view that the program has been effective in integrating DRR practices into existing community structures, and in improving community members’ knowledge of the hazards they face and how to address them.The consortium approach of this program provided many benefits in terms of extending the reach of the program, enhancing Government influence, building consensus, and sharing tools and experiences among consortium partners. However, to maximize the effectiveness of a consortium approach without imposing extra burdens on program staff, funding should be provided for consortium management activities. Moreover, a consortium approach is more suitable for longer programs, given the time and effort required to establish them.The program devoted considerable effort to maximizing the participation of women and girls in DRR structures and activities, and to ensure these structures and activities were inclusive of the needs of people with disabilities. Results from the endline KAP and KII results provide a mixed picture regarding the effectiveness of the program’s approach to disability. In a positive sign, there seems to have been an increase – from a very low base – in knowledge and awareness about the need to help people with disabilities in the event of an emergency. However, as reported in this document, a significant percentage of respondents still seem to lack this knowledge and awareness. The results reflect the inherent challenges in changing attitudes about issues relating to disability and in designing programs that are inclusive of the needs of people with disabilities. It is recommended that the consortium partners continue to reflect upon these challenges and consider how they could address these challenges more effectively in future projects.While the program was designed to achieve sustainable results, the short duration of the program (two years) poses significant challenges for the sustainability of many of the achievements of the program. Achieving long-term improvements in the awareness, attitudes, behaviours and practices of all persons in a community – particularly in relation to a “new” concept such as disaster risk reduction and management – requires on-going support, monitoring and refresher training that is difficult to implement within a two-year project. The new DDR modules have been rolled out successfully to all target schools. The sustainability of this rollout will depend, in part, on whether funding is secured to implement the Government’s commitment to a national rollout of DRR modules. If a national rollout does not occur in the next few years, and in the absence of on-going support and funding for the program’s target schools, there is a risk that the new DRR modules will not be able to be sustained, and instead the school curricula will revert to the mainstream national curricula. This risk should be considered carefully in the design of future projects that involve changes to school curricula.Based on the lessons learned from the design and implementation of this program, the following recommendations are made with a view to improve programming in this area in the future.First, there are substantial benefits to a consortium approach to program implementation, and this type of approach should be encouraged in future programming. A consortium approach works best in instances where each member brings different but complementary capabilities to the consortium, and where adequate resources are allocated to consortium management activities.Second, reflecting the good practice of this program, future programs should be designed carefully to align with Government priorities and strategies in this area. This program also demonstrates the benefits of working closely with stakeholders at all levels to enhance stakeholder engagement and to create a sense of ownership of the program – which will contribute to the sustainability of program achievements. Third, programs that seek to achieve lasting improvement in attitudes, behaviours and practices in the area of disaster risk management should ideally be implemented over a period longer than two years. This program demonstrates that DRR programs face sustainability challenges if implemented over a two-year period. This program also highlights the complications that can arise when programs are designed in the expectation that further funding will be received to extend the duration of the program. Fourth, those involved in program design and implementation need to keep striving for new and improved ways to make programs more inclusive of the needs of vulnerable groups, particularly people with disabilities as well as women and girls. This program devoted considerable time and effort to the issues of disability and gender, but the KAP survey results on disability highlight the difficulty and complexity of addressing this issue effectively.Fifth, future DRR programming should build on the good work of this program in the area of DRR curriculum development, teacher training and support materials. Consideration should be given to developing new modules for higher school grades (i.e. beyond grade 6) to ensure that key messages continue to be reinforced as children progress through school. Finally, donors and other organizations should continue to advocate for DRR modules to be mainstreamed in the national school curricula. While there is institutional commitment for a national rollout of DRR by 2020, the substantial funding required for such a rollout has yet to be committed. Until funding for a national rollout is secured, program designers need to carefully consider the sustainability of rolling out DRR modules in a limited number of target schools – particularly for programs of relatively short duration (e.g. two years).Appendix A:Final Evaluation Survey QuestionnairesKnowledge Attitude Practice (KAP) Household QuestionnaireGeneral Information1Name of interviewer2Date of interview3Start-time4End-time5Name of respondent6Age of respondent7Gender of respondent FORMCHECKBOX 1 = Man FORMCHECKBOX 0 = Woman8Any disability FORMCHECKBOX 1 = Yes, Please specify_______ FORMCHECKBOX 0 = No9Number of participants (Only for Children group)Female_____________Male___________10Category1 = FORMCHECKBOX Children 9 - 14 FORMCHECKBOX 1 =Grade 3 FORMCHECKBOX 2 =Grade 4 FORMCHECKBOX 3 =Grade 5 FORMCHECKBOX 4 =Out of school2 = FORMCHECKBOX Youth in school (15 – 25) FORMCHECKBOX 1 =Grade 6 FORMCHECKBOX 2 =Grade 7 FORMCHECKBOX 3 =Grade 8 FORMCHECKBOX 4 =Grade 9 FORMCHECKBOX 5 =Grade 10 FORMCHECKBOX 6 =Grade 11 FORMCHECKBOX 7 =Grade 123 = FORMCHECKBOX Youth out of school (15 – 25)4 = FORMCHECKBOX Adult (25+)If answer 1 or 2 is selected in Q811Name of SchoolIf answer 3 is selected in Q812Level of education last attended FORMCHECKBOX 1 =Grade 3 FORMCHECKBOX 2 =Grade 4 FORMCHECKBOX 3 =Grade 5 FORMCHECKBOX 33 =Other, Please Specify:_____________If answer 3 is selected in Q813Source of income FORMCHECKBOX 1 =Livestock FORMCHECKBOX 2 =Agriculture FORMCHECKBOX 3 =Small Business FORMCHECKBOX 4 =NTFP FORMCHECKBOX 33 =Other, Please specify: __________________14Average income US $ _____ / LAK __________ please specify: daily/ monthly / yearlyAll respondents15Number of household Members ____________16Do you or anyone in your household have any type of disability? FORMCHECKBOX 1 =Learning difficulties FORMCHECKBOX 2 =Physical mobility FORMCHECKBOX 3 =Hearing FORMCHECKBOX 4 =Speaking FORMCHECKBOX 5 =Seeing FORMCHECKBOX 33 =Other, Please Specify _______________ FORMCHECKBOX 99 =NA (No Disability)A. KnowledgeA. KnowledgeA1What types of natural or man-made hazards your school or community is subject to?Please select all that apply FORMCHECKBOX 1=typhoon FORMCHECKBOX 2=flood FORMCHECKBOX 3=flash flood FORMCHECKBOX 4=Landslide FORMCHECKBOX 5=Epidemic / Pandemic FORMCHECKBOX 6=Animal disease FORMCHECKBOX 7=Fire FORMCHECKBOX 33=Other, Please Specify _______________ FORMCHECKBOX 89=DK FORMCHECKBOX 99=NA (No Disasters)A2How did you find out this information? FORMCHECKBOX 1=School FORMCHECKBOX 2=Home FORMCHECKBOX 3=Seminars FORMCHECKBOX 4=Organisation FORMCHECKBOX 5=Municipality / Government FORMCHECKBOX 6=Experience FORMCHECKBOX 7=Media (TV, Internet…) FORMCHECKBOX 33=Other, Please Specify _______________ FORMCHECKBOX 89=DK FORMCHECKBOX 99=NA A3In the last 2 years did you assist any information sharing meeting about risk disasters?If Yes, from where. FORMCHECKBOX 1=Yes FORMCHECKBOX 0=NoA4 If Yes, What hazards where covered? FORMCHECKBOX 1=typhoon FORMCHECKBOX 2=flood FORMCHECKBOX 3=flash flood FORMCHECKBOX 4=Landslide FORMCHECKBOX 5=Epidemic / Pandemic FORMCHECKBOX 6=Animal disease FORMCHECKBOX 7=Fire FORMCHECKBOX 33=Other, Please Specify _______________ FORMCHECKBOX 89=DK FORMCHECKBOX 99=NA (No Disasters)A5What programs did you attend?_______________________________ __________________________________A6Did you share this information with relatives and friends? FORMCHECKBOX 1=Yes FORMCHECKBOX 0=NoPlease select 1 for each question1=NoImprovement2345= Big Improvement89=DK / 99=NAA7Compared to two years ago, has your School Disaster Management awareness and practices improve? FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX A8Ongoing disaster risk reduction and preparedness planning at schools FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX A9Integration of risk reduction and preparedness elements into SIP FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX A10Participation of staff in DRR activities FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX A11Participation of students in DRR activities FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX A12Participation of families in DRR activities FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX A13Increased knowledge of standard operating procedures for safety in the event of emergencies FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX A14Educational continuity planning at schools FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX B. PracticeB. PracticeB1Have you been subject to any hazard in the last 2 years? FORMCHECKBOX 1=Yes, Please Specify___________ FORMCHECKBOX 0=NoB2If Yes, What was the impact of the hazard? FORMCHECKBOX 1=Physical impact on people FORMCHECKBOX 2=Physical impact on school facilities FORMCHECKBOX 3=Physical impact on property FORMCHECKBOX 4=Loss of income or housing means FORMCHECKBOX 5=Psychosocial FORMCHECKBOX 6=Impact on school attendance FORMCHECKBOX 33=Other, Please Specify:_________________ FORMCHECKBOX 89=DK FORMCHECKBOX 99=NAB3How were / do you prepare for a hazard?Please select all that applies FORMCHECKBOX 1=Fire Safety (Fire extinguisher, Fire hydrants, smoke detectors…) FORMCHECKBOX 3=First aid kit FORMCHECKBOX 4=Life jackets FORMCHECKBOX 5=Emergency lighting or Flash lights FORMCHECKBOX 6=Equipment for alternative energy (generator/solar power) FORMCHECKBOX 7=Tools or equipment for filtering or cleaning water FORMCHECKBOX 8=Practice evacuation drill FORMCHECKBOX 9=Reunification plan with family / Colleagues… FORMCHECKBOX 33= Other, please specify: ______________________ FORMCHECKBOX 89=Don’t know FORMCHECKBOX 99=NAB4When did you acquire this material________________ Days / Weeks / YearsB5How did you/ could you assist (were assisted) disabled persons FORMCHECKBOX 1=Education programmes FORMCHECKBOX 2=Alert FORMCHECKBOX 3=Evacuation & Transportation FORMCHECKBOX 4=Provided accommodation FORMCHECKBOX 33=Other FORMCHECKBOX 89=DK FORMCHECKBOX 99=NA (Did not assist disabled persons)B6How did the community help you reduce the impact / risk? FORMCHECKBOX 1=Warning FORMCHECKBOX 2=Shelter FORMCHECKBOX 3=Emergency Kit FORMCHECKBOX 4=Megaphones FORMCHECKBOX 5=Small Boats FORMCHECKBOX 6=Information sharing (maps…) FORMCHECKBOX 7=Slope stabilisation for landslide (tree planting, gabion weaving) FORMCHECKBOX 8=Fencing around the school for safety from animal disease FORMCHECKBOX 9=Hand washing facilities FORMCHECKBOX 33=Other, Please Specify:___________________ FORMCHECKBOX 99=NA (Did not receive any sort of help)B7Do you have a DRR action plan in your community / school? FORMCHECKBOX 1=Yes, FORMCHECKBOX 0=NoIf Yes, please select 1 for each question1 = Yes0 = NoB8Does it address the need of Men? FORMCHECKBOX FORMCHECKBOX B9Does it address the need of Women? FORMCHECKBOX FORMCHECKBOX B10Does it address the need of boys FORMCHECKBOX FORMCHECKBOX B11Does it address the need of youth? FORMCHECKBOX FORMCHECKBOX B11Does it address the needs of girls? FORMCHECKBOX FORMCHECKBOX B13Does it address the need of People with Disability? FORMCHECKBOX FORMCHECKBOX B14Does it address the need of minority groups? FORMCHECKBOX FORMCHECKBOX Please select 1 1=Increase2=No change3=Decrease89=DK / 99=NAB15Compared to two years ago, has your preparedness to hazards increase or decrease? FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX Please select 1 1= Strongly Agree2= Agree3= Disagree4= Strongly Disagree89=DK / 99=NAB16Compared to two years ago, access to schools and school infrastructure is safer and disaster resilient FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX B17If 1 or 2, What measurers where taken? FORMCHECKBOX 1=The soil tested FORMCHECKBOX 2=Applied hazard-resilient techniques in the construction and retrofit for safety FORMCHECKBOX 3=School furnishings and equipment designed and installed to minimize potential harm FORMCHECKBOX 4=Evacuation plan FORMCHECKBOX 33=Other, Please specify:_____________ FORMCHECKBOX 89=DK FORMCHECKBOX 99=NAKey Informant Interview (KII) QuestionnaireGeneral Information1Name of interviewer2Date of interview3Start-time4End-time5Name of respondent6Age of respondent7Gender of respondent FORMCHECKBOX 1 = Man FORMCHECKBOX 0 = Woman8Any disability FORMCHECKBOX 1 = Yes, Please specify_______ FORMCHECKBOX 0 = No9Position / representing1 = FORMCHECKBOX Village Administrator/Planning2 = FORMCHECKBOX MHO/PHN3 = FORMCHECKBOX NGO officer4 = FORMCHECKBOX MoLSW Representative5 = FORMCHECKBOX PDMC, DDMC or VDMC member6 = FORMCHECKBOX School Principal/Head Teacher7 = FORMCHECKBOX Village chief33 = FORMCHECKBOX Other, Please Specify:______________12Average income US $ _____ / LAK __________ please specify: daily/ monthly / yearlyFemaleMale13Number of members in the organisation14Anyone in your organisation have any type of disability? FORMCHECKBOX 1 =Learning difficulties FORMCHECKBOX 2 =Physical mobility FORMCHECKBOX 3 =Hearing FORMCHECKBOX 4 =Speaking FORMCHECKBOX 5 =Seeing FORMCHECKBOX 33 =Other, Please Specify _______________ FORMCHECKBOX 99 =NA (No Disability)15What is yours or your organisation role concerning DRR? FORMCHECKBOX 1 =Risk assessment FORMCHECKBOX 1 =Action planning for risk reduction and/or climate change adaptation FORMCHECKBOX 2 =Protection of assets FORMCHECKBOX 3 =Development of response skills FORMCHECKBOX 4 =Organization of post-disaster response, please Specify:______________ FORMCHECKBOX 5 =Stockpiling of response provisions FORMCHECKBOX 6 =Organizational continuity planning FORMCHECKBOX 33 =Other, Please specify:_______________________________ FORMCHECKBOX 89 =DK FORMCHECKBOX 99 =NAA. KnowledgeA. KnowledgeA1What types of natural or man-made hazards your community is subject to?Please select all that apply FORMCHECKBOX 1=typhoon FORMCHECKBOX 2=flood FORMCHECKBOX 3=flash flood FORMCHECKBOX 4=Landslide FORMCHECKBOX 5=Epidemic / Pandemic FORMCHECKBOX 6=Animal disease FORMCHECKBOX 7=Fire FORMCHECKBOX 33=Other, Please Specify _______________ FORMCHECKBOX 89=DK FORMCHECKBOX 99=NA (No Disasters)A2What impacts has climate change on your community?Please select all that apply FORMCHECKBOX 1=Warming temperature FORMCHECKBOX 2=Changes in precipitation FORMCHECKBOX 3=Water supply and quality FORMCHECKBOX 4=Reduced agricultural yields FORMCHECKBOX 5=Health impacts in cities due to heat FORMCHECKBOX 6=Change in lake / River levels FORMCHECKBOX 7=Change in Ecosystem FORMCHECKBOX 8=Increase in hazards occurrences FORMCHECKBOX 33=Other, Please Specify:_________ FORMCHECKBOX 89=Don’t Know FORMCHECKBOX 99=NA (No impact)A3How did you find out this information?Please select all that apply FORMCHECKBOX 1=School FORMCHECKBOX 2=Home FORMCHECKBOX 3=Seminars FORMCHECKBOX 4=Organisation FORMCHECKBOX 5=Municipality / Government FORMCHECKBOX 6=Experience FORMCHECKBOX 7=Media (TV, Internet…) FORMCHECKBOX 33=Other, Please Specify _______________ FORMCHECKBOX 89=DK FORMCHECKBOX 99=NA A4In the last 2 years did you attend any information sharing meeting about risk disasters? FORMCHECKBOX 1=Yes FORMCHECKBOX 0=NoA5 If Yes, What hazards where covered? FORMCHECKBOX 1=typhoon FORMCHECKBOX 2=flood FORMCHECKBOX 3=flash flood FORMCHECKBOX 4=Landslide FORMCHECKBOX 5=Epidemic / Pandemic FORMCHECKBOX 6=Animal disease FORMCHECKBOX 7=Fire FORMCHECKBOX 33=Other, Please Specify _______________ FORMCHECKBOX 89=DK FORMCHECKBOX 99=NA (No Disasters)A6What programs did you attend?_______________________________ __________________________________A7Did you share this information with relatives and friends? FORMCHECKBOX 1=Yes FORMCHECKBOX 0=NoPlease indicate the leve for each question1=Improved2=Stay same3=Decreased89=DK /99=NAA8Compared to two years ago, has your knowledge and understanding of risk and risk management options and skills in monitoring of risk management initiatives improved? FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX B. Practice B. PracticeB1Have you been subject to any hazard in the last 2 years? FORMCHECKBOX 1=Yes, Please Specify___________ FORMCHECKBOX 0=NoB2If Yes, What was the impact of the hazard? FORMCHECKBOX 1=Physical impact on people FORMCHECKBOX 2=Physical impact on school facilities FORMCHECKBOX 3=Physical impact on property FORMCHECKBOX 4=Loss of income or housing means FORMCHECKBOX 5=Psychosocial FORMCHECKBOX 33=Other, Please Specify:_________________ FORMCHECKBOX 89=DK FORMCHECKBOX 99=NAB3How were you / do you prepare for a hazards?Please select all that applies FORMCHECKBOX 1=Fire Safety (Fire extinguisher, Fire hydrants, smoke detectors…) FORMCHECKBOX 3=First aid kit FORMCHECKBOX 4=Life jackets FORMCHECKBOX 5=Emergency lighting or Flash lights FORMCHECKBOX 8=Materials for keeping water out of any area FORMCHECKBOX 9=Equipment for alternative energy (generator/solar power) FORMCHECKBOX 10=Tools or equipment for filtering or cleaning water FORMCHECKBOX 11=Practice evacuation drill FORMCHECKBOX 12=Reunification plan with family / Colleagues… FORMCHECKBOX 13=Early warning system (e.g. Village speaker, rain water measurement…) FORMCHECKBOX 33= Other, please specify: ______________________ FORMCHECKBOX 89=Don’t know FORMCHECKBOX 99=NA FORMCHECKBOX 1=Fire Safety (Fire extinguisher, Fire hydrants, smoke detectors…) FORMCHECKBOX 3=First aid kit FORMCHECKBOX 4=Life jacketsB4When did you acquire this material________________ Days / Weeks / YearsB5Did your organisation / community set up for an early warning system? FORMCHECKBOX 1=Yes FORMCHECKBOX 0=NoB6If Yes, Please specify FORMCHECKBOX 1=Message from weather/meteorology service FORMCHECKBOX 2=Message from other communities FORMCHECKBOX 3=Monitoring within our own community FORMCHECKBOX 4=Message delivered by radio FORMCHECKBOX 5=Message delivered by loudspeaker FORMCHECKBOX 6=Message delivered by telephone FORMCHECKBOX 7=Message delivered in person FORMCHECKBOX 33=Other, Please Specify:_____________ FORMCHECKBOX 89=DK FORMCHECKBOX 99=NAB7How did you / could you assist (were assisted) disabled persons FORMCHECKBOX 1=Education programs FORMCHECKBOX 2=Alert FORMCHECKBOX 3=Evacuation & Transportation FORMCHECKBOX 4=Provided accommodation FORMCHECKBOX 33=Other FORMCHECKBOX 99=NA (Did not assist disabled persons)B8How did the community help you reduce the impact? FORMCHECKBOX 1=Warning FORMCHECKBOX 2=Shelter FORMCHECKBOX 3=Emergency Kit FORMCHECKBOX 4=Megaphones FORMCHECKBOX 5=Small Boats FORMCHECKBOX 6=Information sharing (maps…) FORMCHECKBOX 7=Other equipment or devices FORMCHECKBOX 33=Other, Please Specify:___________________ FORMCHECKBOX 99=NA (Did not receive any sort of help)Please select 1 for each question1=Increase2=No change3=Decrease89=DK / 99=NAB9Compared to two years ago, has your preparedness to hazards increase or decrease? FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX Please select 1 for each question1=Safer2=No change3=Less safe89=DK / 99=NAB10Compared to two years ago, access to schools and school infrastructure is safer and disaster resilient FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX B11If 1 or 2, What measurers where taken? FORMCHECKBOX 1=The soil tested FORMCHECKBOX 2=Applied hazard-resilient techniques in the construction FORMCHECKBOX 3=Backup plan to ensure that school operations continue in case of hazard FORMCHECKBOX 4=School furnishings and equipment designed and installed to minimize potential harm FORMCHECKBOX 5=Evacuation plan FORMCHECKBOX 33=Other, Please specify:_____________ FORMCHECKBOX 89=DK FORMCHECKBOX 99=NAC. ProgramC. ProgramsC1Were you involved in any program(s) in the last 2 years? FORMCHECKBOX 1=Yes, Please Specify___________ FORMCHECKBOX 0=NoC2Who were the stakeholders in the program? FORMCHECKBOX 1=NGOs, please specify:______________________ FORMCHECKBOX 2=Government Officials FORMCHECKBOX 3=Community leaders / Officials FORMCHECKBOX 4=School teachers FORMCHECKBOX 5=Students FORMCHECKBOX 6=DRM representative FORMCHECKBOX 33=Other, Please Specify:___________________________ FORMCHECKBOX 89=DK FORMCHECKBOX 99=NAC3If Save the Children was involved:Was the management ok?Was the capacity of the partner staff ok?Were the resources adequate? FORMCHECKBOX 1=Yes FORMCHECKBOX 0=No, Please explain___________C4Goal of the project and strategy of the government match? FORMCHECKBOX 1=Yes FORMCHECKBOX 0=No, Please explain___________To support the plan of the NSEDP 2011-2015C5Promoting inclusion of women and girls, ethnic groups and?communities in remote areas FORMCHECKBOX 1=Yes FORMCHECKBOX 0=No, Please explain___________C6Focus towards rural development and poverty eradication through DRR FORMCHECKBOX 1=Yes FORMCHECKBOX 0=No, Please explain___________C7Expand educational opportunities through DRR extra-curricular activities FORMCHECKBOX 1=Yes FORMCHECKBOX 0=No, Please explain___________C8Build better management staff and highly skilled workers through capacity building and training. FORMCHECKBOX 1=Yes FORMCHECKBOX 0=No, Please explain___________C9Secure the country from losses due to natural disasters FORMCHECKBOX 1=Yes FORMCHECKBOX 0=No, Please explain___________C10Maintenance/infrastructure to promote school safety and disaster prevention and protection. FORMCHECKBOX 1=Yes FORMCHECKBOX 0=No, Please explain___________C11Were there any obvious areas of waste or inefficiency? FORMCHECKBOX 1=Yes, Please Specify___________ FORMCHECKBOX 0=NoC12Did the program cover the need of disabled persons FORMCHECKBOX 1=Yes FORMCHECKBOX 0=NoPlease select 1 for each question1= Strongly Agree2= Agree3= Disagree4= Strongly Disagree89=DK/ 99=NAC13Did the program succeed in achieving its goals?To strengthen the national disaster risk management capacity of Lao Government and communities through an integrated, multi-level approach to Disaster Risk Reduction and Disaster Risk Management capacity building, education and training. FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX Were the activities and outputs consistent with the intended effects and ultimate impact of the project, in terms of…1= Strongly Agree2= Agree3= Disagree4= Strongly Disagree89=DK / 99=NAC14Educational resources for child-clubs and schools are revised and improved using a child-centered approach FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX C15Teacher support materials are improved using participatory approaches FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX C16Children and teachers are trained to conduct HVCA FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX C17Children groups undertake HVCA and subsequent DRR Action Plans in their wider community FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX C18Small scale activities implemented in support of DRR Action Plans. FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX C19Children and youth take a leading role and are advocating for action on DRR and adaptation in their communities FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX C20Practice simulation drills for expected and recurring disasters are undertaken, incorporating the needs of children with disabilities FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX C21School administrators, staff, and students engaged in ongoing school community DRM activities. FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX C22School disaster management plans developed that incorporate the needs of children with disabilities FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX C23School DRM practices linked with the VDMC planning FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX C24School Development Plans are reviewed to incorporate appropriate hazard mitigation FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX C25Training conducted on Infrastructure DRR activity planning for 638 stakeholders FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX C26Schools undertake structural and non-structural hazard protection measures through a small grants program FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX / FORMCHECKBOX Please select 1 for each question1=Enabler2=Constraint89=DK / 99=NAC27Which of these are program enablers or constraints1=Organization support FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX 2=Financial FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX 3=Time FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX 4=Human resources FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX 5=Material FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX 6=Information FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX 33=Other, Please Specify:_____________ FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX 89=DK99=NAC28Which practices have been started? Will they continue? Why or why not?_______________________________________________________________________________________________________________________________________________________________________________________________________________C29How has the project contributed to the implementation of the National Disaster Management Strategy?____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________C30Is there evidence that GoL or village level structure has adopted practices/ attitudes FORMCHECKBOX 1=Yes, Please Specify__________________ FORMCHECKBOX 0=NoRate impact of transfer from MOLSW to MONRE on following aspects of the program:1 negative impact23 neutral / no impact45 positive impactC31Timeliness / responsiveness FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX C32Effectiveness FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX C33Sustainability FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX C34Suitable for all groups (gender, ethnicity, disabled persons…) FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX FORMCHECKBOX Appendix B:KAP Survey Report (Baseline versus Endline)This KAP Survey Report compares the results from the baseline and endline Knowledge Attitude and Practice (KAP) household surveys. In some questions, results are also shown for the Key Informant Interviews (KIIs) with that were conducted with school principals, teachers, local NGO staff and village/district officials.Sample overviewAs highlighted in the tables below, the samples in the baseline and endline surveys are quite similar in terms of number, gender and location (province) of respondents.The two main differences between the samples are:The baseline survey includes only three youth in school, compared to 39 youth in school in the endline survey. Different villages were surveyed in Bokeo in the baseline and endline surveys. (The same villages were surveyed in the other provinces.)Table SEQ Table \* ARABIC 5: Sample comparison – by provinceProvinceBaselineEndlineChildYouth in schoolYouth out of schoolAdultKAP TotalKIIChildYouth in schoolYouth out of schoolAdultKAP TotalKIIBokeo3312940103254010284011840Bolikamxai2009285715201010206012Luang Prabang22082757172068205420Xiengkhouang3622341102174013224011520Total11136913631974120396812034792In the KAP surveys, females comprise 50% of the baseline and 52% of the endline. Female ratios are lower in the KIIs (19% in baseline and 30% in endline). Table SEQ Table \* ARABIC 6: Sample comparison – by genderGenderBaselineEndlineChildYouth in schoolYouth out of schoolAdultKAP TotalKIIChildYouth in schoolYouth out of schoolAdultKAP TotalKIIMale5102780158555620266416664Female6034255160136419425618128Not recorded116Total11136913631974120396812034792In the KAP surveys, the number of respondent households that have a person with a disability was quite low in both the baseline (18 households, or 6%) and the endline (6 households, or 2%). These low percentages may indicate some level of under-reporting or a lack of understanding about the breadth of conditions covered by the term “disability”. Knowledge and awarenessWhen asked to name the hazards faced by their community, the response rate in the baseline KAP survey was very low. In total, only 34 respondents (10%) nominated a total of 45 hazards, with another 12 respondents (4%) saying their community did not face any hazards. A response rate of just 14% suggests that baseline enumerators most likely did not explain or elaborate on the question if the participant did not understand it, but instead just moved onto the next question. It may also reflect the fact that prior to the program, the target communities had little exposure the concept of “hazard”. In the endline survey, but contrast, 97% of KAP respondents nominated a total of 890 hazards (average 2.6 hazards per participant). The most common hazards mentioned were flood, animal disease, landslide and typhoon. (It should be noted that endline enumerators provided additional explanation or prompting in cases where participants appeared not to understand the question.) Table SEQ Table \* ARABIC 7 What types of natural or man-made hazards is your community subject to??BaselineEndlineFloodTyphoonFireDroughtNo hazardFloodTyphoonLandslideEpidemic pandemicAnimal diseaseFireWindDroughtColdTotalAv #No hazardDon't knowChild660067055652560251015153402.800Youth813214583155245314195132722.531Adult7200269305331691314452882.44KAP2121211219711617380182523324338902.671KII-----835352345727121063343.600In the endline survey, KAP participants were asked where they found out information about the hazards they face (see table below). In total, 110 children (92%) received information on hazards from school, as well as from other sources. In contrast, in the baseline survey, children were asked if they learned about floods at school, to which only 39% said yes, 51% said no and 10% did not respond.Table SEQ Table \* ARABIC 8 Endline Survey: How did you find out this information?SchoolHomeSeminarsNGOMunicipalityPersonal experienceMediaOtherDon’t knowN/AChild11050503515Youth16913411822Adult1412620281315KAP15175543820221KII1286821647811256528In the endline survey, when asked if they had attended an information meeting about risks or disasters in the last two years, 96% of children said they had attended, compared with 51% of youth in school, 66% of youth out of school and 85% of adults. As highlighted in the table below, respondents perceived the consortium member operating in their province to be the main provider of this information. Table SEQ Table \* ARABIC 9 Endline Survey: If you attended an information meeting in last two years, who provided the information?Consortium memberSchoolOtherDon't knowTotalBokeo8106693Bolikamxai23244051Luang Prabang1956939Xiengkhouang9900099All provinces222291615282Those endline participants who had attended information sessions were asked what hazards were covered in the sessions. As shown in the table below, respondents perceived that a wide range of hazards were covered in the sessions, with flooding topping the list.Table SEQ Table \* ARABIC 10 Endline Survey: If you attend an information meeting in last two years, what hazards were covered??FloodAnimal diseaseLandslideTyphoonEpidemic pandemicFireFlash floodOtherDon't knowChild74%43%57%61%48%52%13%17%0%Youth in school45%50%65%35%20%20%10%20%0%Youth out of school73%49%40%18%31%31%4%11%2%Adult56%70%50%40%48%34%19%7%4%Total65%54%52%45%43%40%13%13%2%Note: percentages show the percentage of those participants who attended a session.As shown in the table below, most endline respondents believe there has been substantial improvement in their school disaster management awareness and practices compared to two years ago. (Respondents were asked to rate the level of improvement on a scale from 1 (no improvement) to 5 (big improvement). Table SEQ Table \* ARABIC 11 Endline Survey: Compared to 2 years ago, have your school disaster management awareness/practices improved?1No improvement2345Big improvementDon’t knowTotalChild002525655120Youth in school0081613239Youth out of school011019281068Adult21525816120Total22488518723347Using the same rating scale, endline respondents were asked to rate the level of improvement on key elements of DRR. The results are presented in the table below.Table SEQ Table \* ARABIC 12 Endline Survey: Please rate improvement compared to 2 years ago?1No improvement2345Big improvementDon’t knowTotalDRR & preparedness planning at school22488518723347Integration of risk reduction & preparedness elements into SOP120907212737347Participation of staff in DRR 325896210167347Participation of students in DRR 119727111668347Participation of families in DRR1235757211934347Knowledge of standard operating procedures for safety in emergency6261145310147347Educational continuity planning at school1186353104108347PracticesIn the KAP surveys, participants were asked if they had experienced a hazard in recent years (within the last three years in the baseline, and within the last two years in the endline). In total, 47% of baseline respondents said they had experienced a hazard in the last three years, while 66% of endline respondents said they had experienced a hazard in the last two years. The table below shows the type of hazard experienced by the baseline and endline respondents (endline results are broken down by province). Baseline respondents listed a total of 197 hazards that their community had experienced, compared to a total of 313 hazards in the endline survey. The table highlights that endline respondents in different provinces perceived different hazards. For example, flooding was perceived to be the most common hazard in Bokeo and Bolikamxai, compared to landslides in Luang Prabang and animal disease in Xiengkhouang. Table SEQ Table \* ARABIC 13 Baseline versus endline: Type of hazard experienced in last 2 yearsFloodLandslideWindAnimal diseaseFireDroughtVery coldOtherAll hazardsNo hazardDon’t know/ No responseBASELINE8532450310071977397ENDLINE121695141188503131170 Bokeo702138211740153240 Bolikamxai29024000035260 Luang Prabang18365170006760 Xiengkhouang412634011058610In terms of the perceived impact of these hazards, only 20 baseline respondents gave at least one impact of the hazards they have experienced, with the most common being loss of income and property damage. Responses in the endline survey were greater in number and diversity, where the most common impacts were loss of income, psycho-social, the death of animals and crop damage. See table below for details.Table SEQ Table \* ARABIC 14 Baseline versus endline: Impact of hazard experienced in last 2 yearsLoss of incomePsycho-socialAnimals diedCrop damageProperty damageImpact on school attendanceOtherDon’t knowN/ABASELINE13015130014191ENDLINE825042322214101820 Bokeo573902793320 Bolikamxai6061761000 Luang Prabang141122345150 Xiengkhouang50341160200Respondents in the endline survey were asked how they did (or could) prepare for the hazards they face. In total, 66% of respondents provided at least one suggestion on what they could do, with 32% saying they didn’t know what to do and a further 2% saying they did nothing. While only 22% of adults said they didn’t know what to do, half of all children said they didn’t know what to do.Table SEQ Table \* ARABIC 15 Endline Survey: How did you / could you prepare for the hazard?ChildrenYouth in SchoolYouth out of SchoolAdultTotalReunification plan253172671Practice evacuation drill206113067First aid102111235Tools for clean water07101532Prepare move to safer location5371126Prepare move clothes/food to safer location568625Injection for animals001515Inform somebody51107Life jackets00112Other027514Do nothing50117Don’t know60101626112In terms of how the community helped them to reduce the threat or impact of the hazards faced, 59% of all respondents were able to nominate at least one activity. Around two thirds of all children said they didn’t receive any help from the community, which may indicate that children are not aware of the things that are being done to help them.Table SEQ Table \* ARABIC 16 Endline Survey: How did the community help you to reduce the threat or impact of the hazard?ChildrenYouth in SchoolYouth out of SchoolAdultTotalMegaphones20233150124Warning153142759Shelter0061319Slope stabilization512311Information sharing ( maps)02226Emergency kit00202Other0351220Didn’t receive any help8091933141% participants who gave a suggestion33%77%72%78%59%According to the baseline results, only 23% of respondents said they knew a person with a disability and agreed there are things that can be done to make them safe. When asked what things can be done to help them, only 6% of baseline respondents were able to provide a suggestion (4% children, 11% youth and 6% adults), with the only suggestion being to help move the person to a safer place.By comparison, 46% of endline respondents were able to provide at least one suggestion for helping a person with a disability in the event of a disaster or emergency (see table below for details). The three most common suggestions were helping to evacuate or transport, alerting the person, and through education programs.Table SEQ Table \* ARABIC 17 Endline Survey: How did you / could you help a person with a disability?ChildrenYouth in schoolYouth out of schoolAdultTotal Evacuate or transport10142760111 Alert20231944 Education programs108111342 Provide accommodation01135Other00011Don't know80233746186% participants who gave a suggestion33%41%46%62%46%Regarding DRR action plans, around 70% of endline respondents said there is a DRR action plan in their community or school (89% in Luang Prabang, 87% in Bolikamxai, 74% in Bokeo and 49% in Xiengkhouang). Knowledge of the existence of DRR action plans was lowest among youth out of school (60%) compared to other categories (71-74%). By comparison, to the same question in the baseline survey, six respondents said there was no action plan and all other participants did not answer the question.In the endline survey, when asked if their community’s DRR action plan addresses the needs of certain groups:93% believe it addresses the needs of men, while 90% believe it addresses the needs of women81% believe it addresses the needs of boys, while 93% believe it addresses the needs of girls81% believe it addresses the needs of youth65% believe it addresses the needs of people with disabilities90% believe it addresses the needs of minority groups. As the table below shows, around 76% of all respondents believe that their preparedness to hazards has increased over the last two years. Table SEQ Table \* ARABIC 18 Endline Survey: Compared to two years ago, has your preparedness to hazards increased or decreased?Increased preparednessNo changeDecreased preparednessDon’t knowTotalBokeo87%10%3%0%118Bolikamxai63%20%0%17%60Luang Prabang72%13%11%4%54Xiengkhouang74%18%7%1%115All provinces76%15%5%4%347Children67%21%4%8%120Youth in School87%5%3%5%39Youth out of School72%21%6%1%68Adult85%9%6%0%120All categories76%15%5%4%347Encouragingly, 89% of endline respondents believe that access to schools and school infrastructure is safer and more disaster resilient than two years ago. Table SEQ Table \* ARABIC 19 Endline Survey: Compared to two years ago, is access to schools and school infrastructure safer/disaster resilient?Strongly agreeAgreeDisagreeStrongly disagreeDon’t knowTotalBokeo27%66%2%4%1%118Bolikamxai28%42%3%0%27%60Luang Prabang43%54%0%0%4%54Xiengkhouang28%62%0%0%10%115All provinces30%59%1%1%9%347Children29%50%0%4%17%120Youth in School18%74%0%0%8%39Youth out of School26%62%3%0%9%68Adult37%60%2%0%2%120All categories30%59%1%1%9%347In terms of which measures they perceive to have made their schools safer, the most commonly cited measure was the use of hazard resistant construction techniques and retrofit of existing buildings. Table SEQ Table \* ARABIC 20 Endline Survey: If agree, what measures have been taken to make schools safer?BokeoBolikamxaiLuang PrabangXiengkhouangTotal Hazard resistant construction & retrofit55341857164 Evacuation plan27261146 Soil tested1023538New/improved school building0002727 School equipment designed to minimize harm1053018Other60006Don’t know31101529Total1024239145328 ................
................
In order to avoid copyright disputes, this page is only a partial summary.
To fulfill the demand for quickly locating and searching documents.
It is intelligent file search solution for home and business.
Related download
- summary training report
- technical evaluation report
- purpose description of the evaluation report
- final report about the training course conducted
- educational evaluation report
- drr final evaluation draft report plan international
- annual statement performance and evaluation report
- panama buena vista union school district
- massgrad final evaluation report
- probation period evaluation report
Related searches
- evaluation and monitoring plan template
- plan international zimbabwe vacancies
- business marketing plan draft sample
- plan international vacancies in malawi
- plan international uganda jobs
- plan international zambia
- plan international job vacancies
- international high school evaluation services
- final cost report nysed
- project final report template
- project final summary report template
- final grant report sample