Terms of Reference
“Most Significant Change” – Participatory Evaluation
ADPP needs independent documentation of the impact and successes of one of its projects. This can be done by conducing “most significant change” sessions with the stakeholders of a specific project. ADPP looks for a consultant who is conversant to the most significant change methodology technique as a form of participatory evaluation. ADPP will receive the CV and proposal within the 7 days of the posting this announcement on the website.
The most significant change (MSC) technique is a form of participatory monitoring and evaluation. It is participatory because many project stakeholders are involved both in deciding the sorts of change to be recorded and in analysing the data. It is a form of monitoring because it occurs throughout the project cycle and provides information to help people manage the project. It contributes to evaluation because it provides data on impact and outcomes that can be used to help assess the performance of the program as a whole. Essentially, the process involves the collection of significant change (SC) stories emanating from the field level, and the systematic selection of the most significant of these stories by panels of designated stakeholders or staff. The designated staff and stakeholders are initially involved by ‘searching’ for project impact. Once changes have been captured, various people sit down together, read the stories aloud and have regular and often in-depth discussions about the value of these reported changes. When the technique is implemented successfully, whole teams of people begin to focus their attention on project impact.
The consultant will select the team participants based on project participants and in consultation with the ADPP’s coordination office for schools.
Lucala municipality, Kwanza Norte
Purpose and Description
1. Document qualitatively and quantitatively the most significant success stories of the project.
2. Develop the capacity of ADPP staff to continue with MSC in the future for ongoing M&E.
i) Preliminary Definition of Domains and purposeful sampling of key interviewees. Headmasters of EPF and EPP to select right interviewees looking for significant changes in five domains with particular sensitivity to gender:
- Changes in the quality of individual and family’s lives
- Changes in the nature of people’s participation in development activities
- Changes in the perception about quality of life
- Changes in livelihood after receiving education
- Changes in social and economic situation.
ii) Collecting Significant Change Stories
- Group discussion
- Individual Interviews
- Use story documentation form
- Quantification of SC stories to the extent appropriate: how many people were involved, how many activities took place and to quantify effects of different kinds and financial impact if possible.
- Story teller consent
- Verification by a native speaker
- Photograph of the story teller
iii) Selecting the MSCS
- Provincial level by the team participants; the group decides which stories are felt to be most significant and the reasons for the group’s choice(s) are documented.
- As above at national level by ADPP team
iv) Feedback to the provincial and community level
- Translation and feedback communication to the provincial and community level.
v) Secondary Analysis
- Secondary analysis involves the examination, classification and analysis of the content (or themes) across a set of SC stories.
vi) Selection and development of material for communication and marketing
- who selected the story, and what their role was.
- how they selected the story – from how many others and over what period.
- why they chose this story over other stories.
Overall Time frame
There will be three weeks of consultancy including one week in Kwanza Norte to interview different stakeholders.
- Five fully documented, selected, Most Significant Change Stories presented to ADPP Luanda.
- Report on the MSC Process with lessons learned and recommendations.
- Assessment of project achievement against project objectives and log-frame