Consultant Terms of Reference: Achieving Change Together (ACT) Project Mid-Term Evaluation (Re-Announcement)

Right To Play Thailand Foundation

BACKGROUND:

Right To Play International

Right To Play is a global organization committed to improving the lives of children and youth affected by conflict, disease and poverty. Established in 2000, Right To Play has pioneered a unique play-based approach to learning and development which focuses on quality education, life skills, health, gender equality, child protection and building peaceful communities. With programming in over 20 countries, Right To Play transforms the lives of more than one million children each week using play and sports, both inside and outside of the classroom. In addition to our work with children, Right To Play advocates with parents, local communities, and governments to advance the fundamental rights of all children.

Right To Play is headquartered in Toronto, Canada and has been operational in Thailand since 2002.

To learn more, visit us at: http://righttoplay.or.th/en/

Achieving Change Together (ACT) Project

Background

Right To Play has been implementing a project in collaboration with the IKEA Foundation. The Achieving Change Together (ACT) Project uses sports and play to improve the well-being of children and youth (aged 5-18) in Thailand. Specifically, the project focuses on children living in seven refugee camps along the Thai-Myanmar border, migrant children living in Myanmar border towns and Phuket, and youth in detention/rehabilitation centres across the country. The project aims to develop their life skills and strives to give them a greater voice in their community to influence decisions that affect their lives. The project is now half way through its 4 years and is due to have a mid-term evaluation.

Program Overview:

PURPOSE OF CONSULTANCY:

ACT is currently at the end of this second year of implementation. The main aim of the Mid-Term Evaluation will be to systematically analyse ACT’s progress and achievements so far.

Following the initial baseline undertaken in 2017, the findings of this mid-term exercise will inform the further implementation of the project, allowing to fine-tune and – where needed – redirect current strategies to maximally achieve aspired impact.

Specific objectives and key Mid-Term Evaluation questions

The specific objectives of the Mid-Term Evaluation are:

1. Evaluate progress towards outcomes
2. Develop concrete recommendations for the next years of project implementation
3. Stimulate learning and reflection among RTP and youth groups, including from what has or hasn’t worked so far
4. Check-in against baseline recommendations.

The following questions are to be answered 

• Effectiveness: What are the principal outcomes/contributions achieved so far by the project? Were there unexpected positive or negative results? Based on available evidence, have these outcomes generated improved life skills for children and youth? Is RTP’s Model of meaningful participation (space, voice, audience and influence as basis) enabling children to participate in decision making? What changes are recommended to further increase effectiveness?
• Relevance of participatory approach for children and youth target group? Are changes so far in line with the logic underlying the Theory of Change, ultimately realizing the final impact? Did the approach suit the priorities, expectations and needs of the children and youth and their communities?
• Sustainability: What actions are or need to be taken to ensure sustained benefits for children and young people beyond the project lifetime?

A range of studies, including a mixed methods external 2017 baseline study and internal 2018 Participatory Outcome Monitoring on life skills research (qualitative) is available to inform the Mid-Term Evaluation. The baseline comprised a quantitative survey (children, parents; key stakeholders); Focus Group Discussion (children, parents); Key Informant Interviews (Teacher, head teacher, high-level stakeholder) administrated in Migrant Communities, Temporary Shelters, and Youth Rehabilitation Centers.

For this purpose, Right To Play is currently seeking a consultant to design and implement the project mid-term evaluation of the “Achieving Change Together” Project. Specifically, the consultant will:

• Conduct a desk review and research on existing results and documents related to monitoring and evaluation exercises Right To Play had done so far as part of ongoing M&E activities. Consultants are expected to use findings from internal 2018 Participatory Outcome Monitoring on life skills qualitative research study with findings arising from Mid-term exercise
• Design and plan for an mid term evaluation in collaboration with the Right To Play staff and implementing partners of “Achieving Change Together” Project.
• Develop the overall approach and methodology for the extended evaluation.
• Review and refine existing tools, where necessary, design the tools to be used during evaluation (including translation/localization work when needed).
• Share the proposed data collection methodology in advance with Monitoring and Programs teams
• Provide recommendations and plans for gathering, integrating, and consolidating of data through data collection tools and/or other required data sets necessary for completing comprehensive analysis of project outputs and outcomes as well as impact of the project (if exist and measurable).
• Produce a comprehensive report based on the findings and evaluation results in line with the project goal and outcome indicators.

SCOPE OF WORK:

1. Preparing a whole evaluation plan outlining the approach/methodology to be employed in executing the assignment and a detailed plan for the whole processes of evaluation:
• Timeline/schedule of activities.
• Sampling requirements / framework (determine sample size for intervention and comparison areas)
• Detailed methodology of how to collect, triangulate and summarize the primary and secondary data of both quantitative and qualitative (if needed, develop data quality protocols to guide data collection/entry for Right To Play staff, including spot checking protocols).
2. Actively participate in regular meetings with Right To Play staff, consulting on research plan/methodology/timeframe, discussing results and findings and agreed recommended follow-up actions.
3. Depending on the consultant’s evaluation plan, collaborate and coordinate with RTP staff and travel to selected evaluation locations to manage data collection process and monitoring of data collection and storage. This includes assuring the credibility of field data collected by interviewers.
4. Compile a comprehensive first draft of evaluation report (including of inherited evaluation structure according to the baseline study and the results from extended evaluation) based on the findings according to the format agreed with Right To Play staff.
5. Prepare and submit final evaluation report to Right To Play staff, including:
• Conduct de-briefing meeting with Right To Play staff at the Right To Play office;
• Copies of cleaned original data sets including any field notes, as well as annexes of processed results tables (with all levels of disaggregation, including geographical areas breakdown) are to be submitted to Right To Play Thailand Country Office with the draft report

6. Prepare a final slide deck of the summary of the report findings for sharing internally and with relevant stakeholders.

METHODOLOGY

The tools to be used for mid-term evaluation will utilize both qualitative and quantitative methods to collect data ensuring in-depth analysis of output and outcome results according to the set indicators. Data collection methods will include guideline, some important background review of project and necessary data set considered relevant and important.

The interview or any other approaches to be used as part of the evaluation will be conducted in the sampling location e.g. migrant communities, temporary shelters, juvenile vocational training centers where the project is implemented. The consultant will be supported by Right To Play staff in arranging logistics for meetings with key stakeholders; the Country Director (CD), MEL Officers (MEL), Program Director (PD), Program Managers (PM) and Assistant Program Managers (APM) will guide review of the consultant inception write up and draft of evaluation draft report.

The consultant will be expected to travel to the project locations that are chosen based on sampling methodology and samples sizes.

DURATION OF THE ROLE

The programme evaluation should be conducted from December 2018 over three months. Specific level of effort for the consultant will be based on the agreed work plan that will be finalized with the contract.

KEY DELIVERABLES

LINES OF COMMUNICATION

The consultant will report to Program Director Thailand.

QUALIFICATIONS OF CONSULTANT

• Demonstrated 5 years experience in programme evaluation design, including selecting methodology appropriate for the project’s-specific factors, sampling, applying a mixed methods approach, developing tools, developing data quality protocols and data interpretation and analysis;
• Demonstrated 5 years’ experience in quantitative and qualitative data analysis;
• Knowledge and experience with child and youth development and/or life-skill development programs;
• Knowledge and experience working with refugee and/or migrant populations in Thailand is highly preferred
• Knowledge and experience working under context appropriateness with Ministry of Justice (MOJ) and Department of Juvenile Observation and Protection (DJOP) is highly preferred;
• Knowledge and experience working with schools and juvenile vocational training centers under the MOJ in Thailand (context appropriateness) is highly preferred;
• Research experience working with children and youth from vulnerable communities will be a strong advantage;
• Fluency in English and Thai; fluency in Burmese/Karen is an asset
• Ability to produce high quality work under tight timeframes.

APPLICATION PROCESS

Consultants/Firms that meet the requirements should submit expression of interest, which should include the following:

• Cover letter including the consultant’s/firm’s suitability for the assignment and current contact information;
• CV including contact details of 2 referees. If the lead consultant is planning to recruit sub-contractors for conducting this assignment in Thailand to support the data collection from various sites, data entry and dataset development, please state this in your application and provide details (cost, expertise, expected role of each consultant, etc.);
• Detailed response to TOR, with specific focus addressing the purpose and objectives of the assignment, methodology to be used and key selection criteria (max. 2 pages);
• Detailed budget breakdown based on expected daily rates and initial work plan;
• Initial draft of the proposed work plan in Gantt chart style.

Deadline to submit the expression of interest is 12:00 Noon (GMT+7) 11 November 2018.

Applications will be sent to “thailandhr@righttoplay.com” titled “ACT Project Mid-Term Evaluation – Consultant/Firm Name”.