Toolkit for Monitoring and Evaluation of Agricultural ...

[Pages:305]44799

World Bank Agricultural and Rural Development Department

Toolkit for Monitoring and Evaluation of Agricultural Water Management Projects

Water for Food Team

Public Disclosure Authorized

Public Disclosure Authorized

Public Disclosure Authorized

Public Disclosure Authorized

FOREWORD

Demands for accountability and results in development assistance have been at the forefront of the international agenda over the past years. In 2004, the World Bank adopted the results framework as a way to shift the focus from implementing activities to achieving and demonstrating results. It has since brought continued attention to Monitoring and Evaluation (M&E) as a key performance feedback system.

The World Bank has long been a major lender to Agricultural Water Management (AWM), and investments in AWM have greatly contributed to meeting escalating food demands and fostering rural development in developing countries. Yet pressures on agricultural water are intensifying, with the need to meet ever-rising food demands while at the same time increasing farmer incomes, reducing poverty, and protecting the environment, all from an increasingly constrained water resource base. The performance of AWM projects has improved in many aspects over the years, but evaluations continue to report major weaknesses in their M&E systems whilst the challenging context would require a much better understanding of what works and does not work.

The Toolkit has been prepared to respond to these challenges. It is mainly targeted towards World Bank professionals and their partners in countries who are responsible for designing, implementing, and using a results-based M&E system in AWM projects. There are difficulties to overcome, some of them specific to the sector, but when implemented properly the M&E system can be of great assistance in the design of the project, its implementation, and its assessment.

The Toolkit comprises a set of guiding principles and helpful resources. It consists of three main parts: an introduction and overview for project M&E, is followed by guidance notes with explanations and examples on specific components of the M&E system, and by a set of resources for projects. Most of the Toolkit is focused on the specifics of World Bank AWM projects. Many of the principles and techniques covered however are generic and widely applicable.

Improving M&E in our projects is crucial for assuring their quality and demonstrating achievements. We hope that this Toolkit will assist project practitioners in successfully implementing the results-agenda.

Salah Darghouth Water Adviser for Food and Agriculture The World Bank

Toolkit for Monitoring and Evaluation of Agricultural Water Management Projects

CONTENTS

Acknowledgements Acronyms and abbreviations

PART A ? Toolkit for Monitoring and Evaluation of Agricultural Water Management Projects

1.0 Introduction and overview

1.1 Purpose of the Toolkit 1.2 Users of the Toolkit 1.3 How to use the Toolkit: approach and structure 1.4 Application of the Toolkit

2.0 The nature of agricultural water management projects

2.1 The importance of agricultural water management (AWM) 2.2 Definition of AWM projects ? what they involve 2.3 The World Bank and agricultural water management 2.4 Recent M&E practice in AWM projects 2.5 Categorising AWM projects 2.6 Implications for M&E design

3.0 Introduction to monitoring and evaluation

3.1 Introduction 3.2 Concepts and definitions 3.3 The purposes of monitoring and evaluation in the project cycle 3.4 The use of logical framework and Results Framework in project design and M&E 3.5 Linking project design to monitoring and evaluation 3.6 The limits of project management 3.7 The challenges of outcome and impact monitoring and evaluation 3.8 The role of leading indicators 3.9 Results-based monitoring and evaluation 3.10 Making results-based monitoring and evaluation work

4.0 Components of monitoring and evaluation systems

4.1 Introduction 4.2 Planning and implementing a project monitoring and evaluation system 4.3 The components of a project monitoring and evaluation system

Further reading

4 AWM M&E Toolkit

Toolkit for Monitoring and Evaluation of Agricultural Water Management Projects

Part B ? Tools and Guidelines for AWM projects

GN1. Building a results framework for M&E of AWM projects

Introduction Building a results framework Specifying data collection, reporting and dissemination requirements

GN2. Logical Framework Analysis

Background The logical framework matrix Strengths and weaknesses of logical framework approach Stages in logical framework analysis

GN3. Choosing and specifying indicators

What are indicators? Choosing and specifying impact and outcome indicators Choosing and specifying cross-cutting indicators Choosing and specifying exogenous or external indicators Choosing and specifying input, process, and output indicators Example indicators for AWM projects

GN4. Linking project and M&E design for AWM projects

Introduction Flowchart diagrams illustrating causal chains (project logic) for key interventions Conclusion

GN5. Organizational alternatives for M&E of AWM projects

Introduction Conducting a `readiness assessment' prior to design and implementation of a project M&E system Organizational arrangement for project M&E Sectoral level monitoring and evaluation Implementing project M&E Building capacity and sustainable M&E systems Incentives and a management perspective

GN6. Data collection, processing, and analysis for M&E of AWM projects

Introduction Assessing data sources Planning requirements Core data collection methods for AWM projects Data analysis Reporting and using M&E findings

GN7. Design and implementation of baseline surveys for AWM projects

Introduction Building baseline information What baseline information should be collected? Baselines and targets

5 AWM M&E Toolkit

Toolkit for Monitoring and Evaluation of Agricultural Water Management Projects

GN8. Remote sensing and GIS applications in M&E of AWM projects

Introduction Background Examples of application Conclusions

GN9. Impact evaluation of AWM projects

Monitoring and evaluation: distinct yet complementary Forms of evaluation in World Bank projects Overarching themes in impact evaluation Key concepts and techniques for impact evaluation Key steps in designing and implementing impact evaluations for AWM projects

GN10. AWM projects and M&E of poverty reduction

The contribution of irrigation to poverty reduction Implementing the poverty reduction mandate of the World Bank Taking poverty into account in Bank AWM projects Defining poverty-related indicators in AWM projects Monitoring and evaluating AWM project outcomes contributing to poverty reduction Methods for M&E of poverty reduction and sources of data Impact evaluation

GN11. Participatory monitoring and evaluation for AWM projects

What is participatory M&E? When and how to use Participatory M&E in projects?

GN12. Actors in M&E of AWM projects

M&E actors in the World Bank project cycle

GN13. World Bank procedures for project M&E

M&E and the World Bank project cycle Main stages in the project cycle Core World Bank procedures and requirements

GN14. M&E for infrastructure rehabilitation and modernization components in AWM projects

Introduction Key activities in rehabilitation and modernization of I&D systems Key performance indicators, data needs and analysis Concluding remarks

GN15. M&E for management, operation, and maintenance components

Introduction Key activities for improving management, operation, and maintenance Key performance indicators, data needs, and analysis Concluding remarks

GN16. M&E for Water Users Association formation and support

Introduction Key activities for WUA formation and support Key performance indicators, data needs, and analysis

6 AWM M&E Toolkit

Toolkit for Monitoring and Evaluation of Agricultural Water Management Projects

GN17. Institutional development in AWM projects

Introduction Typical institutional development components Monitoring and Evaluation of institutional development components

GN18. Benchmarking in Agricultural Water Management

Introduction The difference between project M&E and benchmarking Benchmarking stages Examples of benchmarking in agricultural water management Summary

7 AWM M&E Toolkit

Toolkit for Monitoring and Evaluation of Agricultural Water Management Projects

Part C ? Resources

RN1. Sample terms of reference for M&E of agricultural water management projects RN2. Terms of reference for a baseline survey for an agricultural water management project RN3. Prototype Baseline survey questionnaire for agricultural water management projects RN4. Prototype survey questionnaire for monitoring formation of Water User Associations in agricultural water management projects RN5. Monitoring and evaluation costs RN6. Sample M&E reports RN7. Annotated bibliography related to M&E of AWM Projects RN8. Glossary of terms for monitoring and evaluation of AWM Projects References

8 AWM M&E Toolkit

 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download