Additional attention was drawn to the issue recently by a. All possible teaching measures are not covered, but a more comprehensive list of instruments and studies can be found in approaches to evaluating teacher effectiveness. While there are a variety of different approaches to evaluation, this. Yet there is a need to put the theory into practice in a handson fashion for practitioners. Please note minor addendum to evaluation june 2011 this handbook on planning, monitoring and evaluating for development results is an updated edition of the 2002 edition of handbook on monitoring and evaluation for results 1. The purpose of this handbook is to complement whos evaluation policy annex1 and to streamline evaluation processes by providing stepbystep practical guidance to evaluation in who. It then focuses on the experimental design of an impact evaluation, highlighting its strengths and shortcomings, followed by discussions on various nonexperimental methods.
Quantitative and qualitative methods in impact evaluation and measuring results 1 1 introduction there has been a renewed interest in impact evaluation1 in recent years amongst development agencies and donors. Collecting evidence, demonstrating impact june 2018 uk what is this handbook. There is a need to do impact evaluation if we want to come with such conclusion more on the impact evaluation strategy, see khandker et al. This is a draft and we appreciate your comments and suggestions. Impact evaluation methods for youth employment interventions. It will also feed into the handbook on impact evaluation under preparation, jointly with lacpr. The impact evaluation model can support this process by helping. Defining the key evaluation questions keqs the impact evaluation should address.
The proper analysis of impact requires a counterfactual of what those outcomes would have been in the absence of the intervention. Policy impact evaluation examines changes in key indicators that have occurred since. It then focuses on the experimental design of an impact evaluation, highlighting its strengths and shortcomings, followed by discussions on. Evaluating policy impact step by step evaluating violence and injury prevention policies policy impact evaluation. Impact evaluation seeks to determine the longer term results that are generated by policy decisions, often through interventions, projects or programmes. Impact is a measure of the changes made and impact assessment seeks to establish a causal connection between inputs and changes in terms of magnitude or scale or both. Impact evaluation that aims to increase the number of world bankfinanced projects with impact evaluations, and to build knowledge gained from completed evaluations. A read is counted each time someone views a publication summary such as the title, abstract, and list of authors, clicks on a figure, or views or downloads the fulltext. Impact evaluation a model guidance and practical examples. Handbook of practi cal program evaluation handbook of. An impact survey is an evaluation tool to measure the extent to. This note will be a part section 2 of a position paper on impact evaluation under preparation. Choosing appropriate designs and methods for impact.
Quantitative and qualitative methods in impact evaluation. How to manage genderresponsive evaluation is a practical handbook to help those initiating, managing andor using genderresponsive evaluations. Outline of principles of impact evaluation part i key concepts definition impact evaluation is an assessment of how the intervention being evaluated affects outcomes, whether these effects are intended or unintended. The logframe see module 1 provides the starting pointing for integrating impact assessment with monitoring and evaluation. Impacts may be positive or negative, intended or unintended, direct or indirect. The second edition of the impact evaluation in practice handbook is a comprehensive and accessible introduction to impact evaluation for policymakers and development practitioners. Nor do i apologize for the many areas of mathematical computations that have been conveniently bypassed or ignored. Did the policy produce the intended outcomes and impacts. The handbook is designed as a working tool that will be adapted over time to better reflect the evolving practice. Carlos asenjo ruiz, charlotte gunnarsson and emanuel lohninger. Identifying an appropriate impact evaluation method international labour office.
Although evaluation is useful to document impact and demonstrate accountability,it should also lead to more effective programs,greater learning opportunities,and better knowledge of what works. Samad 2010 the international bank for reconstruction and development the world bank. If you would like to download and print a copy of this guide, please visit. A database with public access to all completed and ongoing world bankfinanced impact. Drawing on good practice impact evaluations the previous chapters have presented the key methods, issues, and challenges that can arise in evaluating project impact. Transmittal sheet, cover page, preface, table of contents. Impact evaluation is an assessment of the impact of an intervention on final welfare. Quantitative methods and practices world bank training series khandker, shahidur r. Undp handbook on planning, monitoring and evaluating for. This is the second edition of the impact evaluation in practice handbook. Strengthen the resultsoriented monitoring and evaluation function and capacity in undp for the purpose of improving programmes and policies, organizational learning and accountability. Policy evaluation applies evaluation principles and methods to examine the content, implementation or impact.
The handbook on monitoring and evaluating for results is intended to. The formal literature on impact evaluation methods and practices is large, with a few useful overviews. Samad 2010 the international bank for reconstruction and development. Handbook on impact evaluation world bank documents. Evaluation is the activity through which we develop an understanding of the merit, worth, and utility of a policy. Handbook on impact evaluation quantitative methods and. Evaluation and impact handbook written and researched by regeneris consulting. For an example in process evaluation, please see the norwegian case electricity savings in households n 3 in chapter 8. The choice of methods and designs for impact evaluation of policies and. The office automation grade evaluation guide and the grade level guide for instructional work are examples of standards used to evaluate positions across occupational lines. It is not my intention to attempt to teach a course in physics nor to discourage anyone from getting a formal education in that field.
First published in 2011, it has been used widely across the development and academic communities. This2009versionofthehandbookonplanning,monitoringandevaluatingfor developmentresultsaimstosupportundpinbecomingmoreresultsorientedand. Ecological basis for environmental impact assessments. This evaluation handbook is designed to encourage dialogue about the role. Manualontrainingevaluation evaluation on this level measures how participants react to the training program. The instructors guide for the third edition of the handbook of practical program evaluation includes class exercises, key terms, and study questions for each chapter.
The retrospective and systematic assessment of a project, program, or selected components of a project or a program to establish the relevance, efficiency, effectiveness, impact, and sustainability. Carrying capacity and habitat as a basis for environmental impact statements. Evaluating the impact of development projects on poverty. Yet there is a need to put the theory into practice in a handson fashion for. Impact evaluations should be focused around answering a small number of highlevel key evaluation questions keqs that will be answered through a combination of evidence. The logframe see module 1 provides the starting pointing for integrating impact assessment with. The handbook of training evaluation and measurement methods is a complete and detailed reference guide suitable for hrd professionals and students in advanced courses in hrd, training evaluation, and program evaluation. However, the meaning of impact evaluation has taken on different meanings over. Examples of outcome and impact indicators are presented in figure 2. Public disclosure authorized public disclosure authorized public disclosure authorized. The second edition of the impact evaluation in practice handbook is a comprehensive and accessible introduction to impact evaluation for policy makers and development practitioners. Chapter 4 drawing on good practice impact evaluations. Appendix c includes brief summaries of each measure presented.
Handbook of training evaluation and measurement methods references. Evaluation is the process of systematically aggregating and synthesizing various types and forms of data for. These questions should be clearly linked to the evaluative criteria. The handbook builds on existing research and practice in educational evaluation. Handbook for monitoring and evaluation 1st edition october 2002.
Does a new road actually raise welfare in a remote area in tanzania, or is it a highway to nowhere. Handbook of training evaluation and measurement methods. The impact evaluation model and the selfevaluation form the ofsted selfevaluation form sef is an opportunity for schools and their partners to demonstrate the positive impact that workforce reform and extended services are making on the lives on children and young people. Contributions by social life and gla regeneration june 2018 gla good growth fund.
1441 32 358 904 472 449 1432 1393 770 787 67 235 937 1206 432 36 751 1467 1309 1647 868 148 713 248 636 1490 785 223 195 1324