ThaiNGO

TERMS OF REFERENCE

Position: External Evaluation Consultant/Expert

Division/ Department: terre des hommes Germany, Bangkok, Thailand

Programme/ Project: Our Rivers Our Life Project (OROL) II: Protection of Our Rivers and Promotion of Ecological Child Right (ECR) in Southeast Asia

Location: Home based with required travel within Thailand, Laos, Vietnam, Cambodia, Myanmar, Philippines, Indonesia.

Languages Required: English

Duration of Initial Contract: 40 working days (extendible to 50 days by collective agreement)

Expected Duration of Assignment: Up to 40 working days (March 2018 – December 2018)

Reporting to: Our Rivers Our Life (OROL) II Project

___________________________________________________________________________

1. Background Information.

terre des hommes Germany is for several years working on ecological child rights with non-government organizations across borders within Southeast Asia. The Regional Working Group Biodiversity (RWG BioDiv) was formed in order to achieve greater impact; this group consists of seven partner organizations and is coordinated by the Secretariat (Southeast Asia Regional Working Group (SEA RWG)). The SEA RWG is responsible for development, monitoring and implementation of the regional project goals, the regional technical exchange and the financial management, via a secretariat that makes use of the office of the NGO ACED in Chiang Rai, Thailand. The seven partner organizations are responsible, in their respective countries, for implementation and more detailed monitoring of local activities of the target groups.  It is not only tdh who values the project partners participating in the endeavor presented here as reliable partners in development cooperation; the 2014 external evaluation of the first project phase certified the that the NGOs were successfully implementing the project and recommended the continuation, expansion and consolidation. The project preparation was drafted in the course of numerous stakeholder meetings and promises a successful project implementation, for which the seven project partners are responsible; they have experience in development work and have proven their technical and administrative skills in the previous project. As with the previous project, the RWG is linked to the tdh Regional Office in terms of administration and is accompanied by the tdh country coordination in an advisory capacity.

'Our Rivers Our Life' (OROL) is a regional river and life protection campaign that works to introduce children to the political debate on environmental child rights; develop OROL’s networks in ASEAN countries; and enforce specific measures to protect the ecosystems and biodiversity of rivers and the livelihoods of people living along the rivers.

2. Purpose of the External Evaluation Consultancy

This Mid - Term evaluation mission will be expected to evaluate the OROL Project phase II. Aside from assessing the progress made, it’s to provide recommendations where and when applicable to improve the projects (results) in particular with regard to lobbying and advocacy work at national and regional levels – to ensure its sustainability.

3. Detailed duties of the External Evaluation Consultancy.

This evaluation will assist OROL II Project partners to understand which activities require further development and which could be considered best practices for further impacts.

The evaluation is expected to make recommendations that:

• Improve the quality of the project;
• Guide/steer future project initiatives, short and long-term;
• Suggest directions for proposal development in relevant related thematic areas such as livelihoods, social protection;
• Identify additional resources from existing and new stakeholders to scale up and sustain the activities and benefits delivered by the project to date
• Demonstrates the proper use of resources (accountability of the funding) by the OROL project and the organizations in charge.

4. Task and process of the External Evaluation Consultancy.

Task and responsibilities

The evaluation will consider:

1] The extent to which the OROL II project has been successful in achieving its objectives (results and impact) from April 2016 to December 2018;

2] The efficient and effective use of resources in relation to all activities implemented;

3] Recommendations for improvements of the project.

Evaluation Process

The preparation of the evaluation process and methods for data collection and analysis shall be proposed by the evaluation expert and the concept should provide as following steps:

1. Inception step (5 working days);

• Desk review: the Consultant will conduct a detailed review of all relevant project documents produced during its implementation. During the desk review the Consultant will focus on evaluating the project baseline, indicators and targets, quality and adequacy of programme approach versus its objectives, outputs and outcomes.
• Workplan: the Consultant will submit a detailed evaluation design and workplan for the evaluation process
• preparation of the field visits: the Consultant will submit a plan for field visits in 7 (“selected”) project countries

1. Evaluation/Field step (30 working days) (extendible to 40 days by collective agreement);

The Consultant is expected to carry out the evaluation of the OROL II Project, via collecting data through interviews, surveys with stakeholders, focused discussions with small groups from partner localities in 7 project countries. OROL II Project will provide support to the Consultant for organizing the meetings, surveys, and interviews, as necessary.

The following projects/areas have to be evaluated:

1. Karen and Mon States (Myanmar)
2. West Java, Yogya in Central Java, Sumatra (Indonesia)
3. Svay Rieng City and Rimdoul District (Cambodia)
4. Salavane and Taoi districts (Laos)
5. Davao City, Cotabato, Maguindanao, Agusan del Sur, Ozamiz (Philippines)
6. Chiang Rai, Chiang Mai, Lampang, Phare and Nan provinces (Thailand)
7. Lam Dong, Binh Phuoc, Binh Duong, Dong Nai, Ba rai-Vung Tau and Ho Chi Minh City (Vietnam).

The Consultant, based in Thailand, will work with all project partners and thus travel to all organizations and project areas in the 7 countries. All projects have to be visited at least once.

When the data collection process is completed, the Consultant will analyze data and information collected (qualitative and quantitative). Then draft an evaluation report including main findings and a concept for a possible follow-up direction.  The key questions that the evaluation seeks to answer should include:

Relevance

       Relevance of the project for the target group:

• Are the existing problems and/or the needs (of the target groups) as well as the proposed solutions identified in an appropriate way to reach the objectives of the project in the project period from April 2016 to December 2018?
• Has the absorption capacity as well as the implementing capacities of the target group been assessed realistically?
• Have the local stakeholders been included appropriately in the process of consultation and participation?
• Have cross-cutting issues as sustainable protection of livelihoods especially for children and youth, protection of ecosystems of the rivers and political debate been respected?

 Planning / Logical framework:

• Is the project coherent and logical? Are the right activities organized for the target groups, resulting in measures that contribute to the project’s objective? Does the project have the SMART indicators to measure progress and change?
• Are the objectives clear and result oriented? Are the inputs well-adjusted to reality? Can the project objectives be reached through the concretely intended project measures? Are the verifiable indicators well-chosen and broadly accepted?
• How flexible and adaptable is the project responding to changing conditions for the project?

 Impact (maybe not all relevant for a Mid-Term)

• What has been the direct contribution of the project to reach the objectives?
• Which results have been reached so far?
• Have there been unforeseen results in the project? If yes, in which way did it influence the general goal of the project?
• Have the selected project indicators been appropriate? If not, have they been adapted in the course of the project?
• Are the applied project measures effective to reach the objectives? Are better measures or methods conceivable?
• As the current cycle of project (April 2016 to December 2018) is the second project phase implemented by 7 partner countries, it is worthwhile to check and measure the outcomes and impacts (both positive and negative) and achievements of the previous project cycles (2012- 2015) and their impacts on the target groups such as children, youth, villagers and communities, farmers, teachers.

 Effectiveness of the project results

This Mid-Term evaluation looks at the project outcomes and assesses how effective the target group has been reached and indeed apply and use new learnt know how and skills in their activities.

• Have the project measures been implemented according to planning and have they reached (the target group)?
• What kind of changes in the livelihoods of the target groups have been caused by the project? (Positive, negative or no change)?
• Did the unforeseen issues impact activities and results? What were the challenges/obstacles to achieving the expected results? How were these challenges/obstacles managed? Did these challenges/obstacles influence the delivery of the results?

 Efficiency

In terms of efficiency this evaluation looks at:

Quality of daily project management

• Budget control
• Personnel management, documentation and information
• Flexibility in project management with respect to changes in the project environment/implementation.
• Involvement of and coordination with local authorities, institutions, target groups and other NGOs

Monitoring of project progress/results

• Status and quality of project monitoring (timely? related to baseline?)
• Is the actual monitoring system adequate for impact monitoring and steering?
• Were the human, financial, material resources been adequate in terms of quality and quantity to achieve project results?

Sustainability

• Can the project measures be continued by the target group after the end of the project period? Are the self-help structures initiated by the project capable to carry on the activities on their own after the project period?
• Is there a sufficient degree of commitment and responsibility among the participants, stakeholders and institutions to guarantee an independent continuation of the activities?
• Can access of the target group to the inputs and services by the project be maintained even after the project period?

Lessons learnt

This Mid-Term evaluation, aside from measuring progress on the implementation of the project, has the particular task to assess how well the project is managing to reach its objectives. Thus conclusions need to be drawn from the project implementation and recommendations formulated that correct and steer for the remaining project period?

1. Deliverables step;

The report shall seek to assess the OROL II Project progress, efficiency and adequacy; process and level of success towards achieving all outcomes and outputs; the quality of project deliverables and the development impact of the OROL II Project initiative, as well as an analysis of the projects contribution/attribution towards achieving the outputs and outcomes. The report should include the success indicators used and an overview of the effectiveness of the project from the perspective of various stakeholders.

            c.1 First draft evaluation report: The draft report will include the positive or negative, expected or unexpected, changes by the project and identify factors which facilitated or abstracted the realization of expected outcomes. The draft evaluation report will be submitted to OROL II Project for an initial review. The minimum structure of the evaluation report (to be written in English language) is the following:

Table of Contents

- Table of Contents

- List of illustrations and tables

- List of abbreviations

Summary

- Background

- Key findings and conclusions

- (Essential) recommendations and, if applicable, Supreme Conclusions/Lessons Learned.

1. Introduction

1.1 Subject of the evaluation

- Brief description of the development measures

1.2 The purpose of the evaluation

- Purpose of the evaluation

- The objective of the evaluation

- Central evaluation questions

1.3 Evaluation Mission

- Period and expiry of the evaluation

- Composition and independence of the evaluation team

- Involvement of partners and target groups in the evaluation

- External factors of influence on the implementation of the evaluation and its consequences.

2. Methodological approach

2.1 Evaluation methodology

- Methodological approach and tools

- Measures to ensure the protection of the parties concerned

2.2 Critical assessment

- Suitability and limits of the methodological approach

3. Framework conditions

- Framework conditions, problems and potentials at the beginning of the development process and important changes in its course

- Presence and activities of other stakeholders

- Risks to the success of the project’s outcomes.

4. Development of the capacity of the project and partners

- Personnel qualification

- Other changes to project promoters and implementing partners

5. Development policy effectiveness

5.1 Relevance

- Consistency of the objectives with the needs of the target groups and with the objectives of the donor, the beneficiary / project partner, the implementing partners and, where applicable, the countries

- Appropriateness of basic developmental policy orientation and design

5.2 Effectiveness

- Quality of the planning of the development measure

- Quality of the target system and the indicators

- The quality of the implementation of the development measure

- Motivation, ownership and legitimacy of the project owner

- Quality of the management of development

- Obtaining the target

- Other (possibly also negative) effects at the level of outputs and direct effects

5.3. Efficiency

- Ratio of costs and benefits (minimum: detailed presentation of costs)

5.4 Overall development policy effects

- Achievement/contribution to the overarching development policy objectives

- The development models and structures that allow for a broad acceptance and implementation of new practices.

- Other (possibly also negative) effects at the level of the overriding effects

5.5 Sustainability

- Durability of the positive effects (after completion of the promotion), also with regard to the development of the environment and the target group’s ability to continue/maintain.

- Risks and potentials for sustainable effectiveness at the organizational and target group level

6. Cross-Section Questions

- Development policy cross-cutting

- Possibly. Contribution to the organizational objectives of the beneficiary

7. Conclusions, recommendations and lessons learned

7.1 Conclusions

7.2 Recommendations

7.3 Lessons Learned

8. Annexes

c.2 Submission of the evaluation report 

The Consultant is expected to prepare the final evaluation report with recommendations and identified lessons learned from the implementation of this project. Suggestions and comments gathered during the briefing session will be taken into consideration. Also, any observations that may arise from the evaluation will be incorporated into the final report.

5. Duty station – work place

The project office, located in Bangkok, provides office space. Printing, scan and copy facilities are available. The Consultant is expected to bring his/her own laptop to use in the office. However, the Consultant and Project Coordinator can agree on another location when suitable.

6. Supervision

The immediate supervisor of the External Evaluation Consultant is the OROL II Project Coordinator, representing the Program Director of the OROL II project: the tdh Regional Coordinator SEA.

7. Profile.

Required experience, qualifications, attitude and personality for this position:

• Advanced university degree in social sciences, political sciences, public administration, Environment, Human Resources, or in a related field; 
• Minimum 5 years of relevant professional experience in project evaluation, especially working with (ethnic) minorities, youth and community based organizations;
• Excellent English language skills both in writing and speaking, and preferably some language skills of one of the project countries;
• Proven analytical skills and ability to conceptualize and write concisely and clearly
• Excellent inter-personal and inter-cultural skills;
• Willing and able to frequent travel under (sometimes) basic conditions;
• Based in Bangkok Thailand (recommended).

8. Costs and fees

The project awards a lump sum payment for these services that will include costs for visa, translation etc.  For other expenses such as travel, food and accommodation will be paid based on original receipts. The payment for this contract will be done in installments as mutually agreed based on the workplan.

 How to apply:

Any interested applicant should send

- A curriculum vitae (CV),

- Cover letter expressing their interest,

- Proposal (workplan) with budget

to the OROL II Project Coordinator, email: wsittirin@yahoo.com as soon as possible or no later than March 9, 2018. Only shortlisted candidates will be contacted for an interview.