Monitoring and Evaluation Facilitator's Guide

314 Pages·2015·7.16 MB·English

by  Rachel Elrom

Monitoring
and Evaluation
Facilitator’s Guide
FSN Network M&E Task Force
May 2015
Monitoring and Evaluation
Facilitator’s Guide
The Technical and Operational Performance Support (TOPS) Program is the USAID/Food
for Peace-funded learning mechanism that generates, captures, disseminates, and
applies the highest quality information, knowledge, and promising practices in
development food assistance programming, to ensure that more communities and
households benefit from the U.S. Government’s investment in fighting global hunger.
Through technical capacity building, a small grants program to fund research,
documentation and innovation, and an in-person and online community of practice (the
Food Security and Nutrition [FSN] Network), The TOPS Program empowers food security
implementers and the donor community to make lasting impact for millions of the
world’s most vulnerable people.
Led by Save the Children, The TOPS Program is a consortium program drawing on the
expertise of its partners: CORE Group (knowledge management), Food for the Hungry
(social and behavioral change), Mercy Corps (agriculture and natural resource
management), and TANGO International (monitoring and evaluation). Save the Children
brings its experience and expertise in commodity management, gender, and nutrition
and food technology, as well as the management of this 5-year (2010–2015) US$20
million award.
Disclaimer:
The Technical and Operational Performance Support (TOPS) Program was made possible
by the generous support and contribution of the American people through the U.S.
Agency for International Development (USAID). The contents of this guide were created
by The TOPS Program and do not necessarily reflect the views of USAID or the U.S.
Government.
Recommended Citation:
The Food Security and Nutrition Network Monitoring and Evaluation Task Force. 2015.
Monitoring and Evaluation Facilitator’s Guide. Washington, DC: The TOPS Program.
Contact:
The TOPS Program
c/o Save the Children
2000 L Street, NW, Suite 500
Washington, DC 20036
Monitoring and Evaluation Facilitator’s Guide
Contents
Abbreviations and Acronyms ....................................................................................... i
Acknowledgements ................................................................................................... iii
Foreword .................................................................................................................. iv
Introduction ............................................................................................................... 1
Preparation for Training ........................................................................................ 1
Summary of the Modules ...................................................................................... 1
Module 1: Monitoring and Evaluation ........................................................................ 3
Lesson 1.1: M&E Overview .................................................................................... 4
Learning Objectives ................................................................................................. 4
Companion Materials .............................................................................................. 4
Slides ....................................................................................................................... 4
Summary of Key Concepts .................................................................................... 11
Handout 1.1.1: M&E Concepts and Terminology ................................................. 12
Lesson 1.2: Revisiting IPTT: What makes a good IPTT? ......................................... 16
Learning Objectives ............................................................................................... 16
Companion Materials ............................................................................................ 16
Slides ..................................................................................................................... 17
Test Your Knowledge ............................................................................................ 29
Summary of Key Concepts .................................................................................... 30
Handout 1.2.1: Creating Indicators Activity .......................................................... 31
Handout 1.2.2: Develop Indicators at Each Level ................................................. 32
Handout 1.2.3: Sources of Standard International Indicators .............................. 33
Handout 1.2.4: Test Your Knowledge about Indicators ........................................ 34
Lesson 1.3: Introduction to Theory of Change/Development Hypothesis ............. 35
Learning Objectives ............................................................................................... 35
Companion Materials ............................................................................................ 35
Slides ..................................................................................................................... 35
Summary of Key Concepts .................................................................................... 44
Handout 1.3.1: Introduction to Theory of Change ............................................... 45
Lesson 1.4: Data Quality and Data Quality Assessments ...................................... 56
Learning Objectives ............................................................................................... 56
Companion Materials ............................................................................................ 56
Slides ..................................................................................................................... 56
Summary of Key Concepts .................................................................................... 64

Contents
The TOPS Program and FSN Network
Lesson 1.5: Data Flow and Uses of Information ................................................... 65
Learning Objectives ............................................................................................... 65
Companion Materials ............................................................................................ 65
Slides ..................................................................................................................... 65
Small Group Work ................................................................................................. 70
Summary of Key Concepts .................................................................................... 71
Handout 1.5.1: Data Flow ..................................................................................... 72
Lesson 1.6: Quantitative Sampling ...................................................................... 73
Learning Objectives ............................................................................................... 73
Companion Materials ............................................................................................ 73
Slides ..................................................................................................................... 73
Summary of Key Concepts .................................................................................... 81
Handout 1.6.1: Sample Size Calculator ................................................................. 82
Lesson 1.7: Gender Considerations in M&E ......................................................... 83
Learning Objectives ............................................................................................... 84
Companion Materials ............................................................................................ 84
Introduction 1: Gender and the Project Cycle ...................................................... 84
Introduction 2: Integrating Gender in the Project Cycle ...................................... 85
Introduction 3: Role of M&E in Addressing Gender ............................................. 85
Discussion.............................................................................................................. 86
Small Group Work ................................................................................................. 86
Summary of Key Concepts .................................................................................... 88
Lesson 1.8: The M&E Plan ................................................................................. 102
Learning Objectives ............................................................................................. 102
Companion Materials .......................................................................................... 102
Slides ................................................................................................................... 102
Summary of Key Concepts .................................................................................. 114
Lesson 1.9: M&E Matrix and M&E Plan Exercise ............................................... 115
Learning Objectives ............................................................................................. 115
Companion Materials .......................................................................................... 115
Slides ................................................................................................................... 116
Summary of Key Concepts .................................................................................. 121
Extended Practice Session .................................................................................. 122
Handout 1.9.1: M&E Matrix Worksheet ............................................................. 125
Module 2: Qualitative Tools and Analysis ............................................................... 127
Lesson 2.1: Introduction to Qualitative Methods ............................................... 128
Learning Objectives ............................................................................................. 128
Companion Materials .......................................................................................... 128
Slides ................................................................................................................... 128
Summary of Key Concepts .................................................................................. 135

Contents
Monitoring and Evaluation Facilitator’s Guide
Lesson 2.2: Qualitative Tools ............................................................................. 136
Learning Objectives ............................................................................................. 136
Companion Materials .......................................................................................... 136
Slides ................................................................................................................... 136
Small Group Work ............................................................................................... 142
Summary of Key Concepts .................................................................................. 144
Extended Practice Session: Qualitative Field Work ............................................ 144
Handout 2.2.1: Required Skills of Qualitative Team Members .......................... 147
Handout 2.2.2: Guidance for Conducting Individual and Group Interviews ...... 148
Handout 2.2.3: Sample Topical Outline .............................................................. 150
Lesson 2.3: Qualitative Sampling and Fieldwork Logistics .................................. 153
Learning Objectives ............................................................................................. 153
Companion Materials .......................................................................................... 153
Slides ................................................................................................................... 153
Summary of Key Concepts .................................................................................. 157
Handout 2.3.1: Purposive Sampling: An Overview ............................................. 158
Lesson 2.4: Qualitative Data Analysis ................................................................ 163
Learning Objectives ............................................................................................. 163
Companion Materials .......................................................................................... 163
Extended Practice Session: Organizing and Analyzing Qualitative Data ............ 163
Slides ................................................................................................................... 165
Summary of Key Concepts .................................................................................. 169
Module 3: Statistical Concepts and Data Analysis Session 1 .................................... 171
Lesson 3.1.1: Understanding Variables .............................................................. 172
Learning Objectives ............................................................................................. 172
Companion Materials .......................................................................................... 172
Slides ................................................................................................................... 172
Summary of Key Concepts .................................................................................. 175
Lesson 3.1.2: Introduction to SPSS..................................................................... 176
Learning Objectives ............................................................................................. 176
Companion Materials .......................................................................................... 176
Slides ................................................................................................................... 176
Exercise 3.1.2: Creating Variables and Data Entry in SPSS (Slides 20–22) .......... 179
Summary of Key Concepts .................................................................................. 179
Instructions for Exercise 3.1.2: Creating Variables and Data Entry in SPSS ....... 180
Lesson 3.1.3: Importing, Exporting, Merging, and Restructuring Data in SPSS .... 181
Learning Objectives ............................................................................................. 181
Companion Materials .......................................................................................... 181
Slides ................................................................................................................... 181
Summary of Key Concepts .................................................................................. 185
Instructions for Exercise 3.1.3a: Import and Export Data Files .......................... 186
Contents
The TOPS Program and FSN Network
Instructions for Exercise 3.1.3b: Data Merging .................................................. 186
Instructions for Exercise 3.1.3c: Restructing Data Files and Review of Exporting
....................................................................................................................... 186
Module 3: Statistical Concepts and Data Analysis Session 2 .................................... 187
Lesson 3.2.1: An Introduction to SPSS Syntax .................................................... 188
Learning Objectives ............................................................................................. 188
Companion Materials .......................................................................................... 188
Slides ................................................................................................................... 188
Summary of Key Concepts .................................................................................. 194
Lesson 3.2.2: Introduction to Data Management ............................................... 195
Learning Objectives ............................................................................................. 195
Companion Materials .......................................................................................... 195
Slides ................................................................................................................... 195
Summary of Key Concepts .................................................................................. 197
Lesson 3.2.3: Manipulating SPSS Variables ........................................................ 199
Learning Objectives ............................................................................................. 199
Companion Materials .......................................................................................... 199
Slides ................................................................................................................... 199
Exercise 3.2.3: Manipulation of Variables .......................................................... 202
Summary of Key Concepts .................................................................................. 203
Instructions for Exercise 3.2.3: Manipulation of Variables................................. 204
Lesson 3.2.4: Manipulating SPSS Data Files ....................................................... 205
Learning Objectives ............................................................................................. 205
Companion Materials .......................................................................................... 205
Slides ................................................................................................................... 205
Summary of Key Concepts .................................................................................. 209
Module 3: Statistical Concepts and Data Analysis Session 3 .................................... 210
Lesson 3.3.1: Introduction to Measures of Central Tendency ............................. 211
Learning Objectives ............................................................................................. 211
Companion Materials .......................................................................................... 211
Slides ................................................................................................................... 211
Summary of Key Concepts .................................................................................. 216
Lesson 3.3.2: Introduction to Measures of Dispersion ........................................ 217
Learning Objectives ............................................................................................. 217
Companion Materials .......................................................................................... 217
Slides ................................................................................................................... 217
Summary of Key Concepts .................................................................................. 222

Contents
Monitoring and Evaluation Facilitator’s Guide
Lesson 3.3.3: Generating Descriptive Statistics in SPSS ...................................... 223
Learning Objectives ............................................................................................. 223
Companion Materials .......................................................................................... 223
Slides ................................................................................................................... 223
Exercise 3.3.3: Descriptive Statistics (Slides 23 and 24) ..................................... 229
Summary of Key Concepts .................................................................................. 235
Instructions for Exercise 3.3.3a: Descriptive Statistics ....................................... 236
Instructions for Exercise 3.3.3b: Descriptive Statistics-Means ........................... 237
Module 3: Statistical Concepts and Data Analysis Session 4 .................................... 238
Lesson 3.4.1: Introduction to Statistical Sampling .............................................. 239
Learning Objectives ............................................................................................. 239
Companion Materials .......................................................................................... 239
Slides ................................................................................................................... 239
Summary of Key Concepts .................................................................................. 244
Lesson 3.4.2: Sampling Techniques.................................................................... 245
Learning Objectives ............................................................................................. 245
Companion Materials .......................................................................................... 245
Slides ................................................................................................................... 245
Summary of Key Concepts .................................................................................. 253
Lesson 3.4.3: Understanding Data Weighting .................................................... 254
Learning Objectives ............................................................................................. 254
Companion Materials .......................................................................................... 254
Exercise 3.4.3 (Slide 18) ...................................................................................... 258
Summary of Key Concepts .................................................................................. 258
Instructions for Exercise 3.4.3: Computing Weights .......................................... 259
Lesson 3.4.4: Introduction to Complex Sample Analysis in SPSS ......................... 260
Learning Objectives ............................................................................................. 260
Companion Materials .......................................................................................... 260
Slides ................................................................................................................... 260
Summary of Key Concepts .................................................................................. 268
Module 3: Statistical Concepts and Data Analysis Session 5 .................................... 269
Lesson 3.5: Inferential Statistics ........................................................................ 270
Learning Objectives ............................................................................................. 270
Companion Materials .......................................................................................... 270
Slides ................................................................................................................... 270
Exercise 3.5: Inferential Statistics (Slides 33–34) ............................................... 276
Summary of Key Concepts .................................................................................. 276
Instructions for Exercise 3.5: Introduction to Inferential Statistics .................... 277

Contents
The TOPS Program and FSN Network
Module 3: Statistical Concepts and Data Analysis Session 6 .................................... 278
Lesson 3.6.1: Data Cleaning ............................................................................... 279
Learning Objectives ............................................................................................. 279
Companion Materials .......................................................................................... 279
Slides ................................................................................................................... 279
Summary of Key Concepts .................................................................................. 284
Lesson 3.6.2: Making Data Meaningful .............................................................. 285
Learning Objectives ............................................................................................. 285
Companion Materials .......................................................................................... 285
Slides ................................................................................................................... 285
Summary of Key Concepts .................................................................................. 292
References and Recommended Reading for Each Lesson ......................................... 293
Contents