TERMS OF REFERENCE (TOR)

                              FOR FINAL EVALUATION STUDY OF SINCE PROJECT

 “DEAL: Development of innovative Employment oriented schemes and Active Labour market measures to increase livelihood and decent work opportunities for vulnerable youth and women at risk of irregular migration in Tigray” – LOT 5

1. Introduction, Background and SINCE Programme

SINCE Programme “Stemming Irregular Migration in Northern and Central Ethiopia”, is one of the different initiatives financed under the European Union Emergency Trust Fund for Africa (EU Trust Fund), Addressing the Root Causes of Irregular Migration and Displacement in Africa. SINCE Programme is managed by the Embassy of Italy, in joint cooperation with the Italian Agency for Development Cooperation (AICS).

SINCE intends to foster a more inclusive economic environment across the region to improve the living conditions of potential migrants, returnees, youth and woman. The intervention logic assumes that the reinforcement of productive value chains, access to economic stability, skilled labor, Public Private Partnerships (PPPs), Technical and Vocational Education and Training (TVETs) and future industrial production increase create employment opportunities that help to reduce the root causes and risks of irregular migration. In so doing, SINCE promotes the improvement of potential migrants and returnees’ living conditions through the reinforcement of existing value chains, cluster of enterprises, on the job training and capacity development of the target selected beneficiaries from the main migrant prone Regions and Woredas of the Country, and in particular from the rural towns and urban areas in North and Central Ethiopia.

The Overall Objective of SINCE is to contribute to the reduction of irregular migration from Northern and Central Ethiopia by improving the living conditions of the most vulnerable population, including potential migrants and returnees with specific focus on youth and women.

The Specific Objective is to establish inclusive economic programs that create employment opportunities for potential migrants, returnees and refugees, especially women and youths, in the most migration prone regions of Ethiopia (Addis Ababa, Amhara, Oromia, SNNPR and Tigray) by strengthening the capacities of local vocational training providers (TVET) and promoting public private partnerships (PPPs) in strategic economic clusters.

To shape SINCE actions, an Inception Phase was carried out through the technical assistance of the United Nations Industrial Development Organization (UNIDO) in joint cooperation with the International Labour Organization (ILO) between August 2016 &March 2017. The aim was to gain a better understanding on migration dynamics, particularly the root causes of migration and their nexus with the lack of decent livelihood and employment opportunities in the targeted areas. The Inception Phase focused on “Woredas” within four Regional States (Amhara, Oromia, SNNPR and Tigray), as well as Sub-cities of Addis Ababa City Administration, showing a high incidence of irregular migration and some major migration trends in the target areas.

A Call for Proposals was launched by the Embassy of Italy in July 2017, divided per geographic lots and with the goal to propel the most promising industrial sectors with the highest production potentials in the areas: Leather, Metal working, Construction, Textile, & Agri-business. As a result, five project proposals and corresponding Consortia were selected, one for each Lot. The geographical areas and the Consortia composition is listed below:

·         Addis Ababa City Administration (Sub-cities: Arada, Addis Ketema, Yeka and Kirkos): People In Need (PIN) as Lead Applicant and Volontariato Internazionale per lo Sviluppo (VIS), Concern Worldwide (CWW) and Organization for Child Development and Transformation (CHADET) as Consortium Members;

·         Amhara Region (Woredas of Raya Kobo, Woldya, Dessie, Kalu, Kombolcha and Kemissie): Edukans as Lead Applicant and Confederation of Ethiopian Trade Unions (CETU), Centro Internazionale Famiglie pro Adozione (CIFA), Development Expertise Centre (DEC), HOPE Enterprise Dessie Branch, Kidane Garment Company, Instituto Sindicale per la Cooperazione allo Sviluppo (ISCOS) as Consortium Members);

·         Oromia Region (Woredas: Sinana, Adaba, Asella and Sherka): Cooperazione Internazionale (COOPI) as Lead Applicant and Edukans, Lay Volunteers International Association (LVIA), Maki Batu Cooperatives Union, Siko Mendo Cooperatives Union as Consortium Members;

·         SNNPR Region (Woredas: Siltie and Meskan): International Rescue Committee (IRC) as Lead Applicant and CARE Ethiopia, Jerusalem Children and Community Development Organization (JeCCDO), Selam Awassa Business Group and YME Product Design and Manufacturing as Consortium Members;

·         Tigray Region (Woredas: AtsbiWumberta, Wukro, Mekelle, RayaAlamata): Volontariato Internazionale

per lo Sviluppo (VIS) as Lead Applicant and Comitato Internazionale per lo Sviluppo dei Popoli (CISP), Oxfam GB, Ethiopian Catholic Church – Social and Development Commission/Coordination Office of Adigrat ECC SDCO Ad, Relief Society of Tigray (REST), Mesfin Industrial Engineering PLC, Polytechnic Mekelle as Consortium Members.

.

1. SINCE Project in the Region

The project has been elaborated by VIS (lead applicant)  in synergy with its co-applicants: CISP (with whom VIS implements programs to contrast irregular migration in Tigray), ECC (under which operates the Salesians of Don Bosco, both historical partners of VIS), Oxfam, REST, Mesfin and Mekelle Polytechnic College (with whom VIS already established collaboration for cooperative trainings and skills development trainings) and associates (EFFORT, ITACA Textile PLC, and Sur Construction PLC).

Here following a summary of the outputs and activities. The full proposal will be available to the Activities related to Intermediary Outcome 1: Improved access of beneficiaries to TVET and employments opportunities through the promotion of partnerships among TVET service providers and the private sector leading to the delivery of innovative TVSD programs and pilot active labour policy schemes (voucher system)

Indicators of IO1:

• n. of additional demand driven courses disaggregated by woredas and value chains
• n. PPPs created

·         n. of beneficiaries that attend trainings

·         n of beneficiaries started internship or founded job

·         % women in TVET in sectors usually men driven

Output 1.1 Strengthened capacities of TVET providers in developing and managing innovative training schemes, school to work transition modules, employment packages, human resources management and COC. 

Indicators O1.1

·         N. of TVET and companies that adopt employment packages

·         N. of COC after short courses in 3 target sectors

·         N. of TVET that adopt new methodology for HR management

A.1.1.1 Capacity building and support program leading to further development of job placement offices inside target TVET centres.

A.1.1.2 Development of joint partnership between TVET-market-Job Service Offices for the design of innovative school to work transition and design of voucher system.

A.1.1.3 Capacity building program for experts in management of TVET/TVSD services and in human resources management suitable for the actors of the cluster of excellence that will be established.

A.1.1.4 Training and Peer to peer exchange of best practices among TVET centres and enterprises regarding: 1) design and management of school to work transition (including cooperatives trainings) 2) design short trainings market curricula (TTLM teacher learning modules).

A.1.1.5 Delivery of short trainings programs (on basic and transversal component) for the hard to reach and out of mainstreamed services youth aimed at getting the final certificate of competences.

Output 1.2 Trainings, employment vouchers and soft skills trainings delivered

Indicator O1.2

·          

·         N. of training and employment voucher assigned and performed

·         N. of trainees who acknowledge new soft skills

·         N. of TVET that adopt updated curricula for short courses

A.1.2.1 Delivery of innovative job employment package co-funded through voucher combining different accompanying and school to work measures: 1) Competences assessment, tutoring, and orientation counselling, scouting and active job research; 2) work based learning and skills gaps training oriented modules to facilitate job insertion and reinsertion; 3) dual apprenticeship and internship.

A.1.2.2 Development trainings programs endorsing innovative life and soft skills modules  to all the beneficiaries of skills development (for acquisition and/or updating of soft skills required by enterprises, such as: work ethics, decent work).

Output 1.3 Refugees and returnees who access to MFI program

Indicator O1.3

·         N. of refugees and returnees who benefit from MFI program

A.1.3.1 Support to self-employment and support to the increment of livelihoods opportunities for Eritrean refugees through innovative path in partnership with financial and non-financial service providers (SME offices and MFIs) to facilitate the access to credit for hard to reach and out of mainstreamed services youth and refugees in Tigray.

Output 1.4 Improved attitudes and organizational practices of TVETs and public employment service providing agencies to enhance participation of women in the three strategic economic sectors.

Indicator O1.4

·         % of people accepting work related gender stereotypes

·         No of TVET colleges & No. of public employment organizations that have taken actions to improve inclusion of women

A.1.4.1 Organizational practices of stakeholders (TVET colleges, TVET offices, MSEs, bureau of labour & social affairs) changed informed by action research on factors affecting women’s participation and performance in TVETs in construction, metal work and textile sectors)  & employment opportunities.

A.1.4.2. Development and implementation of behavioural change communication strategies that are targeted to address social norms and gender stereotypes affecting women’s participation in TVET’s and labour force, especially in male dominated sectors such as: construction and metal-works.

Output 1.5 Report on the effectiveness and sustainability of the active employment measures (employment package) and of the school to work transition schemes piloted

Indicator O1.5

·         no. of regional and national policy makers who well received final report

·         no. of TVET providers and market actors not involved into the actions which scaled TVSD and dual apprenticeship schemes piloted

A.1.5.1 Analysis on the effectiveness, sustainability and potential replicability of the measures introduced in the short term in view of their scaling up at regional and national level

Intermediary Outcome 2: Improved capacity of selected industrial clusters to create additional job opportunities with a special focus on the promotion of decent work .

Indicator Io2:

·         % unemployed youth who are employed in cluster reinforced by SINCE

·         % reduction in women unemployment

·         n. of companies who adopt decent work principles

·         n. of innovative employment schemes adopted in cluster

Activities related to Intermediary Outcome 2:

Output 2.1: Public private partnership between TVET, enterprises and collaboration to improve value chains fostered.

Indicator O2.1

• N° of MoU, joint action plans among cooperatives/small companies and big ones within value chain

A.2.1.1 Definition of the main stakeholders (starting from the stakeholders analysis done during the feasibility study) in each level of the value chain in all the 3 strategic economic sectors targeted.

A.2.1.2 Strengthening the relation between cooperatives/small micro enterprises identified in textile and garment sectors, to strengthen the linkage to value chains in the three target sectors.

Output 2.2 Strengthened capacity of TVET providers, industrial clusters and companies to respond to value chains needs and to manage employment oriented programs. 

Indicator O2.2

·         N. of TVET and companies who adopt innovative employment schemes

·         N. Action plan taken inside the platform to establish a cluster of excellence within 2years time

A.2.2.1 Development of TOT and capacity building paths in collaboration with enterprises for middle managers and business management to respond to the need of the value chains and cluster, to boost productivity and employability.

A.2.2.2 Development of capacity building paths and awareness raising events in cooperation with TVET actors oriented to foster greater involvement of the business sector in the development and management of employability oriented programs and of the support to the definition and large scale delivering of Active labour market schemes (Io1).  

A.2.2.3 Analysis of needs, gaps, forecast trends related to each economic sector targeted.

Output 2.3: Improved working conditions and capacity of women to participate in textile, metalwork and construction clusters

Indicator O2.3

·         % of supported women’s enterprises which have increased income & sales volume

·         No. of supported women’s enterprises which have developed new market links

A.2.3.1 Development and implementation of advocacy strategy to promote decent work in the region.

A.2.3.2 Supporting women enterprises (especially those working in male dominated construction and metal work sectors) through affirmative action to develop their capacity.

Output. 2.4 Recommendations on active labour market policy and measures to activate in the medium term youth employability, framed into a comprehensive advocacy strategy delivered and submitted.

Indicator O2.4

·         No. of private companies taking actions to comply with decent work principles (eg. provisions to balance work and family requirement; or actions to ensure gender equality at work)

·         No. of pledges/position papers/shadow reports submitted to national and international fora/organizations

A.2.4.1 Development of a short-medium term shared advocacy strategy to enable full participation of vulnerable groups of job seekers and potential migrants to labour market

A.2.4.2 Support to the enhancement of policy coherence on inclusiveness and openness of employment and educational regional policies

Beneficiaries

The action directly and indirectly target: 35.111 unemployed people in 4 target woredas (20.408 in Mekelle, 4.050 in Raya Alamata, 3.301 in Wukro, 7.752 in Atsibiwomberta) out of which 50% are women and 4.400 returnees.

During the implementation phase, the project has been affected by external and internal factors related to economic development and as result two extensions have been made and some of the targets have been modified and changed. In phase of induction, all these changes will be reported and shared.

1. Objectives of the Final Evaluation

The final evaluation is meant to provide an initial measurement of the expected long term impact for monitoring the success of the project action. The final survey will serve as progress made measurement of the key indicators of the project and to contribute project completion evaluation, thereby using the basis for the project M&E system and the baseline study already accomplished at the beginning of the project implementation. In this context, the baseline data will be used as reference to measure the increased number of employees in the areas of intervention at the end of SINCE Project. The employment rate at the beginning of the project will be used as terms of comparison with data collected at projects conclusion. To put it in nut shell, the overall objective of the end-line evaluation is to understand whether the project objectives of the project have been realized and achieved as compared with the results of the base line study of 2018.

The main objectives of the final evaluation study are the following ones:

·         To measure the impacts against the baseline values and the corresponding target value for all the indicators outlined in SINCE Project Logical Framework (LF)/Monitoring Plan, providing disaggregated data (as required);

·         To determine the relevance, appropriateness and sustainability of the project;

·         To draw key lesson learnt, gaps , best practices on the due course of project implementation;

·         To assess the knowledge, attitude and practices of  the project target beneficiaries on the consequences of irregular migration ;

·         To measure how the monitoring tools and practice elaborated by the project have given a contribution to the implementation and the revision of the project design itself.

·         To evaluate how external and internal factors have affected the project planned;

·         To assess the role of the institutions in the revision of the project strategy of employment and in the overall revision of the project during the implementation phase.

1. Scope of the consultancy

The final evaluation will include review of the project design and assumptions made at the beginning of the project development process, implementation strategies; it will assess the extent to which the project results have been achieved in the area of intervention, namely theTigray Region and the woreda ofAtsbiwomberta, Wukro, Mekelle, Raya/Alamata.

Program Office location: Mekelle

Co-applicant locations:

• CISP – Mekelle
• REST – Mekelle
• ECC – Mekelle
• Oxfam GB – Mekelle
• Mekelle Polytechnic: Mekelle
• Mesfin Industrial Engineering

The consultancy should be conducted in the above mentioned location, considering and visiting all the above mentioned co-applicants. Moreover, we strongly suggest that the following stakeholders to be considered as well:

• EFFORT, ITACA Textile PLC, and Sur Construction PLC (Associates to the project);
• Three private TVET, managed under the responsibility of ECC SDCO (namely: Don Bosco Technical College Mekelle, St. Louise Women’s Development Centre, Wukro St Mary College):
• Key Stakeholders (located in Mekelle):
  • Bureau of Finance and Economic Development (BoFEd)
  • Bureau of Labour and Social Affairs (BoLSA)
  • The Public Employment services (PES)
  • Bureau of Technical Vocational and Education Training
  • Bureau of Youth and Sport,
  • Small and Medium Manufacturing Industry Development Agency
  • Mekelle Industrial Park
  • Tigray Chamber of Commerce and Wukro Chamber of Commerce
  • Woredas of: Atsibiwomberta, Wukro, Mekelle, Raya/Alamata

Target groups

The following groups are targeted and should be considered for the end-line:

A. Vulnerable unemployed and Inactive youth targeted for baseline survey for a total of 2.500 beneficiaries under this category who are potential migrants; according to available data and internal assessment, the majority are men with low education (up to grade 10), coming from rural areas and exposed to family and community pressure to leave and look for better opportunities ought to be considered. They will undergo through the whole process foreseen by the project: assessment of competences; skills development training or re-training; soft skills trainings; employment measure in companies in the three target sectors. Among this category there will be share of returnees (about one third), suffering from social stigma and in need of socio-economic reintegration in their original communities.

Ø  Out of which at least 70% will be interviewed (or the questionnaire will be distributed)

B. Skills trainings and specific business and managerial trainings to facilitate the loan access given by MFI. We plan to reach 150 refugees, selected among the most vulnerable ones who benefit from the out of camp policy most of them are usually men, with limited education and livelihoods opportunities who have been working always in informal sector.

C. Women, who suffer from limited participation in high paying productive male dominated sectors, resulting in lower average wages comparing to men; moreover there are cultural norms and gender stereotypes that prevent them to fully benefit from TVET and employment opportunities.

The project will reach around 830 women (included in the 2.500 beneficiaries) that will benefit from skills development trainings and employment schemes and from awareness raising and advocacy on gender equality. The project will reach further 240 women for specific activities, such as entrepreneurial trainings to improve women led companies productivities and access to loan since, according to our assessment, they face the following challenges: a) gender stereotyped convictions that prevent them from attending trainings in traditionally male dominated sector (even if they are high paying sectors) and to start up related economic activities; b) low access to information on services provided by public employment agencies; c) Limited education and skills training due to their families’ duties.

Ø  Out of which at least 70% will be interviewed (or the questionnaire will be distributed)

1. Methodology and Responsibilities

The end-line study shall be conducted by a Consultant/Consulting Firm, under the supervision of the Lead Applicant VIS and the Consortium Members. The consultant/consulting Firm is expected to come up with a detailed methodology for conducting the end-line study, taking into consideration the local context. The consultant/consulting firm shall develop appropriate tools and propose an appropriate sampling methodology and size that will be discussed and approved. Data should be collected disaggregated, following the requirements outlined in the Monitoring Plan per each indicator. The end-line study should employ both quantitative and qualitative methods, collecting data from different sources and using different methods (triangulation).

To the following methodological suggestions and stages should be given due consideration while designing the research methodology. The main tasks are under the responsibility of consultant/consulting firm, unless otherwise stated:

·         Secondary data review should comprise, at least, the following documents SINCE Project documents including LF and Monitoring Plan; the draft M&E Handbook, guidelines to the call for proposal, the Joint Inception Report (JIPR), the detailed value chain assessment produced by UNIDO, other literature, documents and studies from government departments and other entities;

·         Data needs to relate closely to SINCE Project Objectives, Intermediary Outcomes and Outputs and needs to be disaggregated by gender, age, different target groups and geographical areas.. Therefore, prior to begin the final evaluation study, it is essential to validate key priority areas, indicators and appropriate disaggregation;

·         Particular attention should be paid to the following element: Technical and Vocational Education and Training (TVET), cluster development (in textile, construction and metal work sector), Public Private Partnership (PPP), irregular migration trends and data collection/analysis, employment opportunities creation, gender stereotypes in TVET and private sector;

·         Define appropriate sampling methodology and size for the survey that is statistically valid and cost effective and to identify control groups, if necessary;

·         Design data collection modalities and tools, for both qualitative and quantitative data, including a Knowledge Attitude and Practice (KAP) survey for measuring specific indicators, as described in the  M&E Handbook;

·         Shall be available for meetings with Lead Applicants, Consortium Members, Embassy of Italy, UNIDO as well as other consultant/consulting firm contracted for SINCE Projects in other regions and to be ready to share the end- line methodology and results.

Ownership and Disclosure of Data /Information

All documents, project designs, drawings , data and information shall be treated as confidential and shall not without the written approval of VIS be made available to any third party. In addition, the consultant (s) formally undertakes not to disclose any parts of the confidential information and shall not, without the written approval of VIS be made available to any third party. The utilization of the report is solely at the decision and discretion of VIS. All documents containing both raw data materials provided by VIS and final report both soft and hard copies are to be returned to VIS upon completion of assignment. All documentation and report written as, and as a result of the research or otherwise related to it, shall remain the property of VIS.  No part of the report shall be reproduced except with the prior, expressed and specific written permission of VIS.

1. Duration, timeline and deliverable

The end-line study consultancy will start tentatively from 8^th  of June 2020. The following milestones with corresponding dates should be respected:  

·         Date 18^th May 2020: Signing of the contract

·         Date 10^th  June 2020: Delivery of end-line value regarding overall objective indicators

·         Date: 30^th June 2020: Delivery of end-line value regarding specific objective indicators and output indicators , activities (for the indicators where the baseline value has defined)

1. Profile of Consultant/Consulting firm

ü  Degree in Education, Sociology, Economics or equivalent;

ü  Proven expertise in the domains of Technical and Vocational Education and Training (TVET), cluster development, Public Private Partnership (PPP), irregular migration trends and data collection/analysis, employment opportunities creation and value chain development

ü  Proven knowledge and experience in developing and conducting baseline and end-line studies;

ü  Solid methodological and analytical skills;

ü  Knowledge of local context and the specific Region;

ü  Previous experience working with communities using participatory approaches

ü  Strong quantitative data entry and analysis skills and previous experience using statistical analysis software

ü  Ability to respond to comments and questions in a timely , appropriate manner

ü  Fluency in English and Tigrigna;

ü  Ability to write clearly and concisely in English.