Consultant to Undertake Final Evaluation for Promoting Rural Opportunities for Children’s Empowerment, Education and Development (PROCEED) Project
The PROCEED project implemented by Save the Children (SC) in Thailand is funded by a private donor and aims to empower children, especially the most at-risk girls and boys from ethnic minorities including stateless children, and provide them with knowledge and skills on child rights, child protection, life skills and sexual reproductive health. The project’s duration is for 4 years, from 2017-2020, in 2 districts of Chiang Rai and Mae Hong Son. The project aim is, briefly, to reduce children’s’ risk of sex work, being abused or exploited, and being affected by early pregnancy.
SC works with four implementing partners in Chiang Rai and Mae Hong Son: 1) ECPAT Foundation, 2) Highland People Education and Development Foundation, in Chiang Rai, 3) Legal Status Network Foundation, and 4) The Life Skills Development Foundation, in Mae Hong Son. In order to assess and learn from the process, achievement, challenges, and the overall impact achieved, the final evaluation will be conducted for the purposes at the end point of the project.
At the core of the project’s approaches are the following components providing both preventive and responding measures:
Objective 1: To what extent has the PROCEED project empowered and educated children, especially children from ethnic minorities and stateless children, about child rights and reproductive health, in the targeted districts.
1.1 With the supports from Education Services Area Office (ESAO), schools in the targeted areas provide information and education on child rights and sexual, and reproductive health for children from grade 7 to grade 12.
1.2 Children are provided conducive environments created for all children to organize groups and clubs where they can discuss about their rights, issues of concerns, voice their views in the targeted schools and their communities.
Objective 2: To improve access to social services to children from ethnic minorities and stateless children who are at risk or have entered into the sex business or are affected by early pregnancy in the targeted districts.
2.1 ESAO and schools, in targeted areas, provide counselling/guidance services, adequate information and referral services to children from grade 7 to 12 who are at risk or affected by the identified risks, to appropriate services.
2.2 Stateless children, children from ethnic minorities and their families have accessed to quality and gender sensitive basic services.
Detailed information on projects and their planned outcomes, outputs and indicators can be found in project documents.
The PROCEED project, started in 2016, will end in December 2020 and Save the Children in Thailand is thus seeking to recruit an independent consultant to lead and undertake the final evaluation. External support for the process is particularly important given the need to assess and learn from the process, achievements and challenges encountered in the project.
2.Purpose and scope of this consultancy:
Save the Children Thailand intends to conduct a final evaluation of the PROCEED project to assess the impact of the project and capture main achievements, challenges, as well as documenting best practice examples and lesson learnt. The evaluation report and findings will inform future similar projects. The evaluation will also to ensure accountability towards the donor and beneficiaries of the project. The evaluation report is expected to become a useful resource for all stakeholders. The evaluation will be conducted so as to document how the project adapted to the characteristics of each of the project implementing areas and situations.
The final evaluation aims to answer the following questions:
1. To what extent have the planned objectives in the logical framework of the project been reached per indicator and disaggregated by gender?
2. To what extent have the project activities contributed to the overall goal? Was the project effective in building capacity of social/education/health service providers to protect and provide quality services to children in implementing area? Was the project effective in building ability of children to protect themselves, their peers? Was the project effective in improving assessment to social/education/health service of children and their family/care giver?
3. What were the factors influencing the achievement of the objective of the project?
4. what opportunities for collaboration were utilised and contributed to increase effectiveness?
5. How efficient was the delivery of project, looking at both expenditure, and implementation of activities?
6. Was the project implementation be cost-effective, while not compromising quality and results?
7. What could have been opportunities within the project to reach more beneficiaries within the available budget or to reduce costs while reaching at least the same number of beneficiaries without compromising quality and results?
8. Were the activities implemented in a timely manner against the project plans?
9. How relevant were the objectives and activities implemented by the project in addressing adolescence pregnancy, sexual exploitation in children, and statelessness?
10. To what extent were the project beneficiaries reached?
11. How did beneficiaries perceive the relevance of the project and how did the activities improve their lives? Are there any stories of change?
12. How did the collaboration between Save the Children, implementing partners, and strategic partners contribute to appropriate response to specific needs and priorities of the beneficiaries??
13. To what extent was project able to adapt and provide appropriate response to context change and emerging local needs and the priorities of beneficiaries?
14. What is the impact or effect of the project in proportion to the overall situation of the target group or those effected?
15. Did the activities delivered by project meet the needs and expectations of the beneficiaries? What do beneficiaries feel could be improved in contribution to achieve project’s goals and objectives or help improving local capacity?
16. How was the project implementation monitored? (i.e. internal monitoring, evaluation, accountability, learning (MEAL) and quality assurance mechanism)?
17. what tools/mechanism were utilised to increase project quality?
18. How did project fulfill accountability to children, both girls and boys – consultations with children, information sharing, child friendly feedback and complaints mechanisms, etc?
19. What measures ensured visibility of the project’s added value towards beneficiaries and strategic partners?
20. Which of the interventions, approaches, and modalities/strategies have been most effective according to Save the Children, implementing partners, and strategic partners?
21. Is there any substantial evidence about how project learning were generated and applied to improve the delivery or effectiveness or efficiency of activities?
22. How did the different actors/stakeholders learn from these experience?
23. What could have been improved or changed when we look back at the last three years of the project?
24. To what extent do key decision makers and stakeholders, e.g. project partners and local community, feel ownership of the project? how do they envisage the sustainability of the project? Please provide concrete answers
25. Will the change caused by the project continue beyond the life of the project?
26. How has the project worked with partners/stakeholders to increase their capacity in a sustainable way?
Complementarity and Harmonization:
27. Are there any concrete examples of successful models of collaboration of Save the Children with stakeholders, both in local and national level, not just in terms of avoiding duplication but increasing complementarity and integrated activities affecting the reach and impact on beneficiaries?
28. Have beneficiaries (youths, parents, teachers, communities, for example) increased awareness and improved attitudes related to gender equality?
29. To what extent has the project strengthened the capacities of partner organisations to
provide gender sensitive services?
3. Evaluation Methodology:
An independent consultant will be recruited to lead this final evaluation. The following is the outline of a suggested process; however, it is expected that this will be further refined by the consultant:
Literature/ Desk review:
Data Processing, Analysis and Reporting:
The evaluation shall be undertaken based on the Save the Children International requirements and must be in line with Save the Children’s ethical guideline (Annex II) . The report will be evaluated according to the evaluation quality scoring tool (Annex III).
4.Target areas and groups
The assessment targets children, schools, community, local government agencies as the main informants. The field work will take place in Chiang Rai at Mae Fah Luang and Mae Jan District, and in Mae Hong Son province at Pang Ma Pa and Sob Meai/Mae Sa Riang District.
The consultant will be required to dedicate time to this consultancy work during October to December 2020 period, subject to the requirements and agreements with Save the Children.
6. Schedule and deliverables
Inception report and work plan
10 days after confirmation of contract
Desk review process: Save the Children will review and provide feedback on the first draft within 5 working days.
Submission of finalized Inception report and planning with PROCEED project team
Save the Children will review the updates (and discuss if needed) for its approval
Data collection and consultation with key stakeholders in targeted areas
Presentations of preliminary findings to Save the Children
Presentation file shared with Save the Children at least 3 days prior to the presentation
First draft of reports with recommendations in Thai
Save the Children will provide feedback on the first draft within 5 working days
Final draft of reports
All materials, including all RAW data sets, collected in the undertaking of the consultancy process should be submitted along with the final report.
7. Management of the consultancy:
The consultant(s) will managed by Save the Children’s PROCEED Project Coordinator, with technical support from other staff, who will provide inputs throughout the final evaluation process including on the proposed methodology and data collection tools, analysis and interpretation and recommendations. Furthermore, the project team will be able to provide support for logistics and arrangements for data collection and consultation with stakeholders in remote areas. Support requirements for tasks such as translation and data entry will be discussed with the successful applicant.
8. Consultancy Fee
The consultant(s) is asked to propose the budget in Thai Baht. The financial competitiveness of the fee will be considered in the selection process. Costs involved in the assessment, such as materials, travel, translation and applicable taxes, should be included in the proposed budget.
10. Submissions for the consultancy
The submission must address the terms of reference and include:
11. Close date for submissions:
Applicant (Firms, Individual Supplier) should submit their interest by 25 September 2020 before 17.00 pm. Submissions should be addressed to THA_Procurement_BKK@savethechildren.org
12. Budget Range: THB 300,000-400,000
Annex I: PROCEED Log Frame and other project documents
Annex II: Save the Children’s ethical guideline
Before undertaking any monitoring and evaluation activity with children or adults an ethical assessment should be undertaken by the Country Office. Where appropriate, approval for an activity should be obtained from all relevant ethical or institutional review boards in-country prior to the commencement of the activity.
As per the minimum standards, at each of these stages the responsible individual or office must:
Every data gathering exercise involving children and vulnerable communities is theme or context specific therefore you must review all ethical considerations before undertaking a new activity.
Whenever we conduct research on people, the well-being of research participants must be our top priority. The research question is always of secondary importance. This means that if a choice must be made between doing harm to a participant and doing harm to the research, it is the research that is sacrificed.
In some cases, you may decide that you cannot proceed with a monitoring and evaluation activity because of ethical issues. In this case you may need to re-design the activity or cancel it altogether if an ethical solution cannot be found.
Annex III: Evaluation report quality score tool
Annex IV: Table of Content for the evaluation report (suggestion)
Table of Contents
Acronyms and Abbreviations
Glossary of Evaluation Terms
1. Introduction and background
2. Evaluation purpose, scope and methodology
2.4 Limitations of the evaluation
3. Evaluation Finding
3.8 Complementarity and harmonization
3.9 Gender sensitivity
4. Conclusions, recommendations and lessons learned
4.3 Lessons learned
Annex A. Terms of Reference
Annex B. Organizations visited and persons met
Annex C. Bibliography
Annex D. Logframe
Annex E. Evaluation Matrix
Annex F. Interview Guidelines etc
Period: 16-25 September 2020
Proposal/Price Submission: THA_Procurement_BKK@savethechildren.org
Further enquiries: email@example.com
Contact : firstname.lastname@example.org, THA_Procurement_BKK@savethechildren.org