Measuring Change: Monitoring and Evaluating Leadership Programs: A Guide for Organizations (English Edition)

2010·3.2 MB·English

by  Goyal, Rakhee

M e a s u r i n g C h a n g e
Monitoring and Evaluating
Leadership Programs
A Guide for orGAnizAtions

M e a s u r i n g C h a n g e :
Monitoring and
Evaluating Leadership
Programs
A Guide for Organizations
Rakhee Goyal
Alexandra Pittman
Anna Workman
Tested and adapted in cooperation with
Association Démocratique des Femmes du Maroc, Morocco
BAOBAB for Women’s Human Rights, Nigeria
Center for Research & Training on Development-Action, Lebanon
Sisterhood Is Global Institute/Jordan, Jordan
Women’s Learning Partnership (WLP)
4343 Montgomery Avenue, Suite 201
Bethesda, MD 20814, USA
Tel: [phone]
Fax: [phone]
Email: [email protected]
Web: www.learningpartnership.org
Design & Layout by Xanthus Design
© Copyright 2010
by Women’s Learning Partnership (WLP)
ISBN#: 978-0-9814652-2-7
Table of Contents
Acknowledgements
..............................................................................v
PrefAce
............................................................................................................vii
IntroductIon:
.............................................................................................1
strengthening our Programs through evaluation
worksHoP sessIons
..............................................................................5
section I: developing A framework for monitoring And evaluation............5
Session.1:.How.Do.Our.Programs.Create.Change?...............................................6
Session.2:.How.Do.We.Assess.Our.Programs?...................................................18
Session.3:.How.Do.We.Develop.a.Monitoring.and.Evaluation.Plan?...................23
section II: designing strategies for evaluation workshops........................33
Session.4:.How.Do.We.Select.Participants?........................................................35
Session.5:.How.Do.We.Plan.to.Learn.about.Our.Program?.................................43
Session.6:..How.Do.We.Use.Written.Questionnaires.to.Learn.about..
Program.Impact?...............................................................................46
Session.7:..How.Do.We.Use.Interviews.to.Learn.about.Program.Impact?...........52
Session.8:.How.Do.We.Use.Focus.Groups.to.Learn.about.Program.Impact?......62
section III: reviewing the Progress of our workshops...............................71
Session.9:.How.Are.We.Progressing?..................................................................72
section IV: sharing our learning......................................................................75
Session.10:..How.Do.We.Use.Quantitative.Data.Analysis.to.Demonstrate..
Program.Contributions?...................................................................76
Session.11:..How.Do.We.Use.Qualitative.Data.Analysis.to.Demonstrate..
Program.Contributions?...................................................................87
Session.12:.How.Do.We.Present.Our.Learning?..................................................95
section V: evaluating ourselves......................................................................101
Session.13:.How.Do.We.Assess.Our.Program.and.Organization?.....................102
trAInIng AgendAs
...............................................................................107
Agenda.1:.Mapping.the.Change.Process.Training.............................................108
Agenda.2:.Qualitative.and.Quantitative.Data.Analysis.Training.........................109
Agenda.3:.Training.Institute.on.Monitoring.......................................................110
Agenda.4:.One-Day.Training.Institute.on.Evaluation.........................................111
Agenda.5:.Two-Day.Training.Institute.on.Evaluation.........................................112
HAndouts
....................................................................................................115
APPendIces
................................................................................................173
Appendix.A:.Different.Evaluation.Formats.........................................................173
Appendix.B:.Bibliography..................................................................................175
Appendix.C:.Glossary........................................................................................176
Appendix.D:..Women’s.Learning.Partnership.Publications..
and.Learning.Tools........................................................................179
iv
Acknowledgements
We are grateful for the generous support provided by the following institutions
for the development of the manual:
Dutch Ministry of Foreign Affairs MDG3 Fund
Ford Foundation
National Endowment for Democracy
Oxfam-Novib
Shaler Adams Foundation
Swedish International Development Cooperation Agency
We thank all of our partners for their commitment and dedication to the
implementation and evaluation of the Leading to Choices leadership training
program, and for the valuable feedback we have received from our partners and
program participants, particularly during testing and adaptation of this manual
during grassroots workshops and national training institutes in Morocco (2005-
2009), Nigeria (2007-2009), Jordan (2007-2009), and Lebanon (2007-2009).
Thanks are also owed to Vivian Nguyen and Nanette Pyne for their review of the
text, and we are especially grateful to Jennifer Pendleton for her thoughtfulness
and dedication in finalizing the manual for publication.
v

PrefAce
Who We Are
A partnership of 20 autonomous organizations, Women’s Learning
Partnership (WLP) trains and supports women in the Global South,
primarily in Muslim-majority countries, to become leaders and advocates
for a just, peaceful world. WLP creates culture-specific leadership trainings
on democratic participation, and it partners with local organizations to
help women gain the skills they need to fulfill greater leadership roles at
the family, community, and national levels. Over the past decade, WLP’s
programs and training materials, which have been published in 20 lan-
guages, have reached tens of thousands of women in over 40 countries,
strengthening local organizations to become self-sustaining and to power
women’s movements around the globe.
In 2001, WLP published Leading to Choices, a leadership training manual
with a special focus on women. By 2004, Leading to Choices had been
translated into 11 languages, and adapted for dozens of different cultural
contexts. Over 6,000 women (and men, as well) in the Global South had
participated in workshops based on the leadership manual. Organizations
in the WLP Partnership, who had been regularly assessing the impact of the
leadership trainings, felt the need to take a deeper look at the effects of the
trainings in women’s lives and their communities. They decided to invest
in a systematic monitoring and evaluation program, piloted in Morocco
during 2005 to 2007. Measuring Change: Monitoring and Evaluating
Leadership Programs was developed following the pilot program and early
drafts were reviewed and tested by WLP partners. This publication is the
result of that co-production. www.learningpartnership.org
vii
measuring change: Monitoring and evaluating Leadership Programs
About the WLP Partner Organizations
Afghan Institute of Learning (AIL): AIL is a women-led non-governmental
organization that uses a creative, responsive, and dedicated approach to meet
the health and education needs of Afghan women, children, and communities.
AIL trains and works with health and education professionals and organizations
through programs in teacher training, health professional training and health
education, and leadership and human rights training. Programs support home
schools, community-based organizations, women’s learning centers, and a
pre-school education program. www.afghaninstituteoflearning.org
All Women’s Action Society (AWAM): Founded in 1985, AWAM is an
independent feminist organization committed to improving the lives of women
in Malaysia. Its vision is to create a just, democratic, and equitable society where
women are treated with respect, and are free from all forms of violence and
discrimination. To reach this goal, AWAM informs, connects, and mobilizes those
interested in securing women’s rights, bringing about equality between men and
women, and supporting women in crisis. AWAM’s activities include advocacy,
training and education, and direct services to victims of violence, including
counseling and legal aid. www.awam.org.my
Association Démocratique des Femmes du Maroc (ADFM): ADFM is an
independent association established in 1985 to defend and promote the human
rights of women, and to foster equitable policies and social practices. As one of
the largest non-governmental organizations in Morocco focused on the rights
of women, ADFM has been successful in forming networks with civil society
and governmental institutions regionally and internationally. The organization
guarantees and reinforces the rights of women through advocacy, awareness
raising, literacy campaigns, direct assistance, and education, among other
activities. www.adfm.ma
Association des Femmes Chefs de Famille (AFCF): AFCF is a non-
governmental organization in Mauritania whose primary mission is to promote
human rights and to defend the rights of women and children. AFCF strives
to bring support to women in precarious situations (particularly female heads
of households), create a network of associations working to improve living
conditions for women and children, and contribute to fostering gender
equality and building active solidarity among women of different social
classes. www.afcf.asso.st
viii