Final Report Formative Evaluation of the Sara Radio Programme ... - UNICEF

Final Report

Formative Evaluation of the Sara Radio Programme (SRP) in Iringa DC, Iringa MC, Kilolo DC and Mufindi DC

Prepared for: UNICEF Tanzania Country Office Plot 133, Karume Road Oysterbay, Dar es Salaam Tanzania

Prepared by: The CSR Group Africa Limited Plot 1, Block 47C P. O. Box 33324 Kijitonyama, Dar es Salaam, Tanzania

April 2019

|Page i

Table of Contents List of Figures.....................................................................................................................................................iv List of Tables .......................................................................................................................................................v Acronyms ........................................................................................................................................................... vi Acknowledgements .......................................................................................................................................... vii Executive Summary ......................................................................................................................................... viii Section I: Introduction ....................................................................................................................................... 1

Background and context of the Sara Radio Programme ............................................................................... 1 Policy context for components of the Sara Radio Program (SRP) ................................................................. 3 Formative evaluation objectives ................................................................................................................... 4 Scope of the evaluation................................................................................................................................. 5 Target population for the evaluation ............................................................................................................ 5 Section II: Conceptual approach and methodology .......................................................................................... 6 Sara radio programme theory of change ...................................................................................................... 6 Evaluation criteria.......................................................................................................................................... 8 Methodological design .................................................................................................................................. 9 Sampling approach ........................................................................................................................................ 9 Data collection approach and method ........................................................................................................ 11 Data quality assurance ................................................................................................................................ 11 Ethical considerations for the formative evaluation ................................................................................... 11 Data analysis and report writing ................................................................................................................. 12 The formative evaluation response rate ..................................................................................................... 13 Challenges and limitations of the formative evaluation ............................................................................. 13 Section III: Findings and discussions.................................................................................................................. 1 Demographic information for surveyed children .......................................................................................... 1 Children's' school attendance information ................................................................................................... 2 Sara radio programme (SRP) information ..................................................................................................... 4 HIV/AIDS information .................................................................................................................................... 9 Sexual and reproductive health (SRH) information..................................................................................... 15 Gender equality, equity and inclusion information .................................................................................... 20 Assertiveness, negotiation and decision-making information .................................................................... 23 Child rights, safety and protection information .......................................................................................... 25 Early child marriage and pregnancy information ........................................................................................ 29 Water, sanitation and hygiene (WASH) information .................................................................................. 34 Section IV: Analysis of findings based the formative evaluation criteria ........................................................ 37

| P a g e ii

Relevance .................................................................................................................................................... 37 Effectiveness................................................................................................................................................ 39 Efficiency...................................................................................................................................................... 44 Sustainability ............................................................................................................................................... 48 Equity and gender equality.......................................................................................................................... 50 Section V: Conclusion, lessons learnt and recommendations......................................................................... 51 Challenges in SRP implementation.............................................................................................................. 51 Conclusion ................................................................................................................................................... 51 Lessons learnt .............................................................................................................................................. 53 Recommendations....................................................................................................................................... 53 References ................................................................................................................................................... 55 Annex A: Terms of Reference ......................................................................................................................... 56 Annex B: Restructured Evaluation Questions................................................................................................ 62 Annex C: Data Collection Tools ...................................................................................................................... 64 Annex D: Additional quantitative data tables ............................................................................................. 115 Annex E: Sara Radio Programme Information ............................................................................................. 115 Annex F: HIV/AIDS Information ................................................................................................................... 117 Annex G: Sexual Reproductive Health Information..................................................................................... 119 Annex H: Gender equality, equity and inclusion ......................................................................................... 124 Annex I: Assertiveness and Negotiation ...................................................................................................... 136 Annex J: Child rights, safety and protection ................................................................................................ 142 Annex K: Early pregnancy and child marriage ............................................................................................. 149 Annex L: WASH ............................................................................................................................................. 151 Annex M ........................................................................................................................................................ 155

| P a g e iii

List of Figures Figure 1: Sara Programme Theory of Change.................................................................................................... 7 Figure 2: Percentage of surveyed children in Iringa DC with knowledge of the SRP ........................................ 4 Figure 3: Percentage of children and people they discussed with on SRP key messages................................. 8 Figure 4: Percentage of children with knowledge on how HIV virus can be spread ....................................... 13 Figure 5: Percentage of children's source of information for SRH.................................................................. 17 Figure 6: Percentage of children who think that children with disabilities should not be mixed with children

with no disabilities................................................................................................................................... 23 Figure 7: Children's perceptions on where to report cases of abuse and child rights violation ..................... 27 Figure 8: Percentage of children who can initiate a conversation with a stranger......................................... 29 Figure 9: Percentage of children's perceived reasons for early marriage....................................................... 31 Figure 10: Percentage of children who know of critical points for handwashing........................................... 34 Figure 11: Pupils listening to Sara radio programme at Mkulula primary school ........................................... 42

| P a g e iv

List of Tables Table 1: Evaluation criteria................................................................................................................................ 8 Table 2: Primary schools visited for the formative evaluation........................................................................ 10 Table 3: Summary of evaluation sample size by data collection tool ............................................................. 10 Table 4: Response rate for the formative evaluation...................................................................................... 13 Table 5: Percentage of demographic composition of surveyed children (10-14 years) ................................... 1 Table 6: Percentage of children (10-14 years) on reasons they like going to school........................................ 2 Table 7: Percentage of children missing school for various as mentioned by children .................................... 3 Table 8: Percentage of children's reasons for not regularly listening to the SRP ............................................. 5 Table 9: Percentage of children who remembered themes listened to on Sara radio episodes ...................... 6 Table 10: Percentage of children who indicated the number of students in class while listening to Sara radio

episodes..................................................................................................................................................... 7 Table 11: Percentage of children who enjoyed listening to Sara radio episodes ............................................. 9 Table 12: Percentage of children (10-14 years) on source of information on HIV/AIDS ................................ 11 Table 13: Percentage of children (10-14 years) who perceived that unsafe sex increases chances of getting

HIV infection ............................................................................................................................................ 12 Table 14: Percentage of children who have participated in different programmes with focus on HIV/AIDS 14 Table 15: Percentage of children (10-14 years) on preference of source of information on SRH .................. 18 Table 16: Percentage of children (10-14 years) who how to keep clean and healthy during menstruation.. 19 Table 17: Percentage of children who think they can talk about their rights ................................................. 25 Table 18: Percentage of children (10-14 years) who know of a girl that has dropped out of school because of

marriage .................................................................................................................................................. 30 Table 19: Percentage of children's perceptions on negative consequences of early pregnancy ................... 33 Table 20: Percentage of children who mentioned reasons for washing hands .............................................. 35

|Page v

................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download