Consultant to Undertake Final Evaluation for Supported, Engaged and Loved (SEAL) Project
Since 2004, the new round of deadly conflict has costed thousands of lives, damaged relations between people in Yala, Pattani, and Narathiwat: the three-deep-southern-most provinces of Thailand. This led to significant education disruptions. Many children are developing negative coping mechanisms, such as isolated and violent behaviour, self-harm and drug use, to express their emotions. Nearly one quarter of children in the Deep South live with Post-Traumatic Stress Disorder (PTSD), including nightmares, hyperarousal, difficulty in sleeping or concentrating, emotional numbness and anxiety. Besides, the use of Physical and Humiliating Punishment (PHP) in the household in Thailand is still widely prevalent. According to the latest Multiple Indicator Cluster Survey (MICS), three-quarters of children whose age were between one and fourteen years old have experienced PHP. Save the Children (SC), with the support from SCHK and Porticus plan to launch a pilot project to develop and test positive parenting curriculum in which it is suitable for people in the territory. The project is also aim to review the psychosocial situation of children in the area so as to develop child resilience curriculum for using in the territory. In order to assess and learn from the process, achievement, challenges, and the overall impact achieved, the final evaluation will be conducted for the purposes at the end point of the project.
At the core of the project’s approaches are to rebuild the normalcy and resilience for conflict-affected children in Deep South Thailand; and to develop parenting module alongside with child resilience/Support Engaged Love (SEL) curriculum. Detailed information on projects and their planned outcomes, outputs and indicators can be found in project documents.
The SEAL pilot project, started in January 2020, will end in March 2021 and Save the Children in Thailand is thus seeking to recruit an independent consultant to lead and undertake the final evaluation. External support for the process is particularly important given the need to assess and learn from the process, achievements and challenges encountered in the project.
2.Purpose and scope of this consultancy:
Save the Children Thailand intends to conduct end-line assessment and final evaluation of SEAL pilot project to assess the impact of the project and capture main achievements, challenges, as well as documenting best practice examples and lesson learnt. The end-line assessment is aiming to assess parents and children in four target communities to what extend the caregivers who receive positive parenting training sessions report positive changes in their relationship with their children. The evaluation will ensure accountability towards the donor and beneficiaries of the project. The report is expected to become a useful resource for all stakeholders. The evaluation will be conducted to document how the project adapted to the characteristics of each of the project implementing areas and situations and the findings will inform future similar projects.
The final evaluation aims to answer the following questions:
1. To what extent have the planned objectives in the logical framework of the project been reached per indicator and disaggregated by gender?
2. What were the factors influencing the achievement of the objective of the project?
3. What opportunities for collaboration were utilised and contributed to increase effectiveness?
4. What could have been opportunities within the project to reach more beneficiaries within the available budget or to reduce costs while reaching at least the same number of beneficiaries without compromising quality and results?
5. Were the activities implemented in a timely manner against the project plans?
6. How relevant were the objectives and activities implemented by the project in addressing violence against children and promoting parenting without violence in the Deep South?
7. To what extent were the project beneficiaries reached?
8. How did beneficiaries perceive the relevance of the project and how did the activities improve their lives? Are there any stories of change?
9. To what extent was project able to adapt and provide appropriate response to context change and emerging local needs and the priorities of beneficiaries?
10. Did the activities delivered by project meet the needs and expectations of the beneficiaries? What do beneficiaries feel could be improved in contribution to achieve project’s goals and objectives or help improving local capacity?
11.Are there any unintended change occur as a result of project?
12. How was the project implementation monitored? (i.e. internal monitoring, evaluation, accountability, learning (MEAL) and quality assurance mechanism)?
13. What tools/mechanism were utilised to increase project quality (e.g. manuals, tools, knowledge, expertise provided as well lesson shared and home visits to raise awareness/change parents behaviour to apply non-violent child rearing?)
14. How did project fulfil accountability to children, both girls and boys – consultations with children, information sharing, child friendly feedback and complaints mechanisms, etc?
15. Is there any substantial evidence about how project learning and achievement was generated and applied to improve the delivery or effectiveness or efficiency of activities?
16. How did the different actors/stakeholders learn from these experiences?
17. What could have been improved or changed when we look back at the last fourteen monthsof the project?
18. To what extent do key decision makers and stakeholders, e.g. project partners and local community, feel ownership of the project? How do they envisage the sustainability of the project? Please provide concrete answers
19. Will the change caused by the project continue beyond the life of the project?
20. How has the project worked with partners/stakeholders to increase their capacity in a sustainable way?
àComplementarity and harmonization:
21. Are there any concrete examples of successful models of collaboration of Save the Children with stakeholders, both in local and national level, not just in terms of avoiding duplication but increasing complementarity and integrated activities affecting the reach and impact on beneficiaries?
22. Will the results of the project potentially build foundation necessary for a holistic educational equity and excellence, notably the Social and Emotional Learning (SEL)? Does the project offer the following for the parents?
23. Have beneficiaries (youths, parents, communities, for example) increased awareness and improved attitudes related to children with diversified gender and children with different ability?
24. To what extent has the project strengthened the capacities of partner organisations to
provide gender sensitive services?
3. Evaluation Methodology:
An independent consultant will be recruited to lead this final evaluation. The following is the outline of a suggested process; however, it is be expected that this will be further refined by the consultant:
Literature/ Desk review:
•Review of project documents and background information,
•Development and review of the survey/interview tools to be used for data collection, (Data collection tools for end-line assessment will be share by Save the children)
•Development of sampling methodology to assess the progress of project;
•Leading the administering of data collection, including training of numerators (if applicable),
•Conducting a series of interviews with key informant or/and focus group discussions with beneficiaries and, stakeholders including children, parents, staff of implementing partners, SC staff, and government officials;
Data Processing, Analysis and Reporting:
•Discussion on preliminary findings with formulation of recommendations with SC staff,
•Draft Report in Thai and Final Report in English,
•Presentation on key findings.
The evaluation shall be undertaken based on the Save the Children International requirements and must be in line with Save the Children’s ethical guideline (Annex II). The report will be evaluated according to the evaluation quality scoring tool (Annex III).
4.Target areas and groups
The assessment targets children, parents, community, local government agencies as the main informants. The field work will take place in several communities in Narathiwat province. For end-line assessment consultant expected to collect data form 60 parent and 104 children from target communities.
The consultant will be required to dedicate time to this consultancy work during April to May 2021 period, subject to the requirements and agreements with Save the Children.
6. Schedule and deliverables
Inception report and work plan
10 days after confirmation of contract
Desk review process: Save the Children will review and provide feedback on the first draft within 5 working days.
Submission of finalized Inception report and planning with project team
Save the Children will review the updates (and discuss if needed) for its approval
Data collection and consultation with key stakeholders in targeted areas
Presentations of preliminary findings to Save the Children
Presentation file shared with Save the Children at least 3 days prior to the presentation
First draft of reports with recommendations in Thai
Save the Children will provide feedback on the first draft within 5 working days
Final draft of reports
All materials, including all RAW data sets, collected in the undertaking of the consultancy process should be submitted along with the final report.
7. Management of the consultancy:
The consultant(s) will be managed by Save the Children’s Senior Deep South Field Coordinator, with technical support from other staff, who will provide inputs throughout the final evaluation process including on the proposed methodology and data collection tools, analysis and interpretation and recommendations. Furthermore, the project team will be able to provide support for logistics and arrangements for data collection and consultation with stakeholders in remote areas. Support requirements for tasks such as translation and data entry will be discussed with the successful applicant.
8. Consultancy Fee
The consultant(s) is asked to propose the budget in USD and Thai Baht. The financial competitiveness of the fee will be considered in the selection process. Costs involved in the assessment, such as materials, travel, translation and applicable taxes, should be included in the proposed budget.
• At least master’s degree in child protection, research, social sciences or other related field
• Expertise in qualitative and quantitative research methods
• Strong quantitative and qualitative data analysis skills
• Expertise in issues related to child protection or public health management is an asset
• Experience working with non-profit organizations and familiarity with development work
• Experience in conducing evaluation in multicultural, multilingual and sensitive context will be an asset
• Thai/English language proficiency
• Ability to work within strict deadlines
10. Submissions for the consultancy
The submission must address the terms of reference and include:
• The resume of the lead candidate and team (if any)
• A cover letter explaining the interest and suitability
• Assessment plan and budget proposal including research methodology and timeline (5 pages maximum)
• A detailed budget in USD and THB as specify in the consultant fee section
11. Close date for submissions:
Applicant should submit their interest by 15th March 2021.
Submissions should be addressed to: THA_Procurement_BKK@savethechildren.org
Further enquiry: Yonradee.Wangcharoenpaisan@savethechildren.org
Contact : Yonradee.Wangcharoenpaisan@savethechildren.org