Job Description
Hiring Office: INNOVATION and EVALUATION UNITS
Purpose of consultancy
Background
UNFPA is the United Nations Sexual and Reproductive Health Agency committed to delivering a world where every pregnancy is wanted, every childbirth is safe, and every young person's potential is fulfilled. The East and Southern Africa Regional Office works as an extension of the organization to realize the mandate and goals in the region.
It is estimated that more than 200 million girls and women have experienced female genital mutilation (FGM). 1 in 30 countries across three continents, with half of those cut living in Africa. More than three million girls are at risk of undergoing FGM every year, with most girls cut before the age of 15. FGM is internationally recognized as a violation of human rights and constitutes extreme violence against girls and women. Girls and women subjected to FGM are at risk of early marriage, dropping out of school, and reduced opportunities for growth, development, and sustainable incomes. FGM involves medical, emotional, social, legal, and economic repercussions at all levels of society. Given that 22 out of 30 FGM-affected countries are least- developed, these costs place a burden on the personal, household, community, and state economies. As a result of global efforts to meet the 2030 goals, critical progress is being made in ending FGM.
Ending the practice by 2030 – the target set out in the Sustainable Development Goals – would require redoubling evidence-based efforts and innovation.
UNFPA in ESAR has adopted innovation and digitalisation as an accelerator of UNFPAs Transformative Results (TR), which includes ending preventable maternal death, ending unmet need for family planning and ending gender-based violence and harmful practices. This is reflected in the new UNFPA Strategic Plan, the Regional Action Plan, Nairobi Declaration, innovation and digitalization strategies, and assessment report on the iAccelerator Program 2019, among other Programme reports.
Young people the world over are championing social innovation as an accelerator of solutions to the current political, social, and economic challenges they face. With support from the UNFPA East and Southern Africa Region (ESAR) via the Innovation HackLabs project, young people are developing and scaling innovative solutions to support collective efforts to achieve transformative results, create jobs for themselves and others through their social impact projects. UNFPA in ESAR is committed to supporting the development of an enabling environment to grow innovation in the region.
UNFPA in 2021 initiated the Innovation HackLabs model to identify and support innovation idea generation on the one hand and also support existing ‘startups’ to scale their social innovation enterprises. The project has since achieved some successes including identifying over 300 innovation solutions, providing critical seed and growth funding, access to enterprise support services, investor relations, networks, dialogues and exposure to market opportunities.
UNFPA ESARO is seeking to evaluate the project through determining an approach to crowdsourcing innovation solutions moving forward; determine the impact of the developed innovation solutions (2021-23), assess opportunities for enterprise growth/improvement and development of key recommendations to provide value for money as well as accelerate efforts to achieve the transformative results. The evaluation also seeks to assess the governance systems, the administrative arrangements, support offered, impact of and on recovery from COVID 19.
The evaluation is expected to use innovative and adaptive approaches that offer a 360 degrees’ assessment of the project.
Objectives
UNFPA ESARO is calling for a consultant to evaluate the HackLabs model used to crowdsource innovation (especially harmful practices) solutions from external stakeholders including young people and make strategic recommendations to accelerate efforts towards improving the SRHR innovation ecosystem across Africa.
The evaluation will have four broad components:
Review of the project design, structure and approach as well as the implementation processes over the two years of roll out.
A forward-looking prospective assessment of the HackLabs project which will include a review of the impact of the innovators engaged, viability of the seed fund and business incubation support provided, implementation mechanisms (internal and external), communication and impact measurement and reporting systems including the skills, funding, market access, networking etc using adaptive evaluation approaches
The evaluation will cover implementation at the country and regional level including the governance, administrative processes as well as engagement with external partners; i.e. AfriLabs as an implementing partner.
Assess plausible application of the implementation of the HackLabs model to other thematic issue areas for example Child Marriage, Early and Unintended Pregnancies, Climate Change among others.
Specific Objectives
Identify and document key learning to generate key recommendations for the RO and COs regarding HackLabs and its application to UNFPA’s mode of engagement in the ESA region
Identify key opportunities and recommendations to improve the HackLab programme design, approach, governance, administrative and other implementation processes, and systems (including impact documentation and dissemination).
Propose a viable design and structure for HackLabs implementation in the region aligned to the strategic plan, financial and programme policies and procedures.
Identify opportunities for using innovation hacklabs as part of community resilience building including with COVID 19 recovery efforts.
Scope of work
Desk Review:
The evaluation is expected to conduct a desk review of relevant documents, including the HackLab project concept notes and other project documents, the operational processes and plans and any other relevant reports or documents related to the project. Other documents will include relevant innovation ecosystem publications by UNFPA and other stakeholders. The desk review will provide a foundation for understanding the context, objectives, and expected outcomes of the project.
Evaluation Design:
Based on desk review; the evaluation team will develop and submit an evaluation design and proposal that outlines the data collection methods, data sources, and analysis plan for the evaluation. The evaluation design will be tailored to the specific objectives of the evaluation and will be designed to provide reliable and valid data on the effectiveness of the reproductive health innovation HackLab project.
Data Collection:
The evaluation team will collect data using a range of methods, including surveys, interviews and focus groups among others. The data collection will be designed to provide a comprehensive assessment of the project's impact on improving reproductive health outcomes, the feasibility of scaling up the solutions developed during the HackLab, and the effectiveness of the HackLab in promoting innovation and digital transformation.
Data Analysis:
The evaluation team will analyse the data using a range of quantitative and qualitative methods. The analysis will be designed to provide a detailed assessment of the relevance, potential impact, feasibility, and effectiveness of the HackLab in achieving its intended objectives. The analysis will also identify key challenges and opportunities for improving the effectiveness of future reproductive health innovation initiatives.
Reporting and Recommendations:
The evaluation team will prepare a comprehensive report that summarizes the evaluation findings, conclusions, and recommendations. The report will be tailored to the specific needs of the project stakeholders and will include an executive summary, introduction, methodology, results, conclusions, and recommendations. The recommendations will be based on the evaluation findings and will be designed to provide specific guidance for improving the effectiveness of future reproductive health innovation initiatives.
Presentation of Findings:
The evaluation team will present the evaluation findings to project stakeholders. The presentation will provide an opportunity for stakeholders to ask questions, provide feedback, and engage with the evaluation team on the key findings and recommendations. The presentation will also provide an opportunity for the evaluation team to highlight key areas of concern and provide recommendations for addressing these concerns.
Overall, the scope of work for the evaluation of a reproductive health innovation HackLab project will be designed to provide a comprehensive assessment of the project's impact on improving reproductive health outcomes and promoting innovation and digital transformation in ending harmful practices against women and girls. The evaluation will provide valuable insights into the strengths and weaknesses of the project and will provide specific recommendations for improving the effectiveness of future reproductive health innovation initiatives.
Evaluation Approach and Methodology
The evaluation will adopt adaptive approaches that align with assessing social innovation project implementation and impact assessment. It is expected that lessons will be drawn from best practices in adaptive evaluation that will deliver the best outcomes for scaling the HackLabs model.
The evaluation will be transparent, inclusive, and conducted in a participatory manner. The evaluation will utilize mixed methods and draw on quantitative and qualitative data. The evaluation will also utilise a theory-based approach taking into consideration strategic and planning documents.
The evaluation team will develop the design for the evaluation including the approach, the evaluation criteria and questions contained in a matrix, and methodology for data collection and analysis. Indicative methods for data collection will include documentary review, interviews with key informants, focus groups, showcase studies, online group consultations, and surveys. The evaluation design will be developed during the inception phase of the exercise and presented in the inception report.
The evaluation will follow UNEG Norms and Standards for Evaluation in the UN system and abide by UNEG Ethical Guidelines and Code of Conduct and any other relevant ethical codes.
Evaluation Questions
How has the project contributed to accelerating and providing viable approaches to achieving UNFPA’s Transformative Results?
How has the project contributed to the active participation of young people in SRHR improvement?
What has been the reach and impact of the supported innovation initiatives on the targeted beneficiaries and communities?
How has the project contributed to building community resilience and building forward better post COVID 19?
What has been the impact on the project contributing to achieving UNFPAs climate value proposition as well as targeting populations left behind?
How viable is the governance and administrative structures of the project?
How viable are partnerships and stakeholder engagement plans of the project including engagement of Implementing and other support partners?
How viable is the sustainability model and plan for the project beyond the initial funding?
What has been some of the program and operational challenges that negatively affected the achievement of the objectives of the project
What are the key recommendations for scale, partnership building, resource mobilization, active youth engagement and impact acceleration?
Evaluation process
The evaluation will include 5 main phases, each with distinct milestones and deliverables.
Preparatory phase
Preparation of ToR in coordination with UNFPA ESARO and UNFPA/UNICEF Joint Programme on FGM
Selection of external consultants.
Collection of relevant documentation and creation of document repository in google drive.
Preparation of preliminary stakeholder map by the Evaluation Manager.
Creation of the Evaluation Reference Group.
Design Phase/Inception phase
Desk review of relevant documentation and preliminary meetings with key stakeholders.
Development of a stakeholder map.
Delivery of draft inception report detailing the proposed design of the evaluation and methodological approach including timeframes for deliverables.
Workshop with stakeholders and presentation of draft inception report to the Evaluation Reference Group
Integration of feedback from the ERG into the final inception report.
Field Phase/Data Collection Phase
Stakeholder interviews/ focus groups/ surveys with UNFPA and other UN staff and partners, including:
Members of the UNFPA RO and CO staff including Focal Points
AfriLabs staff and other partners including the innovators, trainers, business coaches etc. engaged over the implementing period
Select UNFPA innovation partners, and UN staff implementing innovation programs
Deliverables
The Evaluation Consultant is expected to deliver the following:
Inception report;
Showcases (4-5);
Powerpoint presentation of inception report for reference group members;
Draft and final evaluation reports;
Powerpoint presentation for Reference Group members;
Workshop for key stakeholders on the results of the evaluation;
The inception report (max 20 pages plus annexes) should include the following elements:
Description of the HackLab and its relevance to accelerating the UNFPA TRs
Evaluation design including a fully-fleshed out methodology;
Time-table for the exercise;
Relevant annexes.
The final report (max 40 pages) should include the following elements:
Description of the HackLabs and organizational context within UNFPA, findings on the review of the implementation processes of the HackLabs initiative;
Description of the methodology utilized;
Findings on the assessment and proposals for improving the Initiative as described above. A comparative analysis of practices by other partners which has informed the assessment will also be included;
Lessons learned from the implementation;
Forward-looking recommendations including actions to operationalize these for the consideration of management;
Relevant annexes.
Duration and working schedule
The consultancy is for 3 months from October – December 2023
Place where services are to be delivered
Home based consultancy/assignment
PHASE TASK TIMELINE (2023)
Preparatory
(September)
TOR finalization Week 2 SeptCollection of relevant documentation and creation of document repository in google drive
Week 2-3 Sept
Selection and engagement of consultant(s)Week 4 Sept – week 2 Oct
Creation of the Evaluation Reference GroupWeek 4 Sept
Inception
(October)
Initial documentary review and interviews
Week 1 Oct
Preparation of preliminary stakeholder map by the Evaluation Manager
First Reference Group meeting for feedback for the preparation of the draft inception reportWeek 2 Oct
Draft inception report
Week 3-4 Oct
Comments from RG
Final inception report submission
Data collection (Nov - Dec)
Internal Stakeholder interviews/ focus groups/ surveys
Week 4 Oct – week 4 Nov
External Stakeholder interviews/ focus groups/ surveys
Reporting
(Dec)
Presentation of preliminary results of data collection phase Week 4 Nov
Draft final report submission Week 1 Dec
Stakeholder reporting workshop Week 2 Dec
Finalization of comments and validation workshop
Final report submissionWeek 4 Dec
Monitoring and progress control, including reporting requirements, periodicity format and deadline:
Monitoring progress of the consultancy will be done by means of bi-weekly teleconferences and /or email messages, by the UNFPA ESARO team. Review of the output will be done by the Innovation Lead and the Regional Monitoring and Evaluation Advisor as well as the Evaluation Reference Group
The consultant is expected to complete the assignment within the set deadlines as per the timelines indicated in this TOR and further agreed during the inception phase.
Supervisory arrangements
The Evaluation will be conducted and managed by the Innovation Specialist UNFPA ESARO with support from the Evaluation Advisor who will have overall responsibility for the management of the evaluation process including supervising the team of external consultants, ensuring the quality and independence of the evaluation and to guarantee its alignment with UNEG Norms and Standards and Ethical Guidelines.
Key roles and responsibilities of the Evaluation Manager include:
Prepare the terms of reference for the evaluation in coordination with the evaluation reference group (ERG);
Hire the team of external consultants;
Supervise and guide the consultant team in each step of the evaluation process;
Review, provide substantive comments and approve the inception report, including the evaluation design and work plan;
Review and provide substantive feedback on all deliverables;
Quality assure the entire evaluation process;
Liaise with the ERG and convene and chair the ERG meetings with the evaluation team;
Identify and ensure the participation of relevant stakeholders in coordination with the ERG throughout the evaluation process;
Contribute to learning, knowledge sharing, the dissemination of the evaluability assessment findings and follow-up on the joint management response.
The final evaluation report will be approved by the Director of the Evaluation Office. 6 of 10
An Evaluation Reference Group (ERG) will support the evaluation at key moments of the process to ensure broad participation on the conceptualization of the exercise. Members will provide substantive technical inputs, will facilitate access to documents and informants, and will ensure the high technical quality of the evaluation products as well as learning and knowledge generation. The ERG will consist of staff from the Innovation, gender, communication units as well as a select number of Innovation Focal Points from across the region.
Expected travel
One trip to at least one UNFPA CO is expected to engage with country stakeholders. This travel will be arranged by the consultant with technical support from UNFPA.
Required expertise, qualifications and competencies, including language requirements
The consultant is expected to bring together the following expertise, qualifications, and competencies:
Qualification and requirements:
The consultant should:
have team members with project evaluation and impact assessment experience
have knowledge of innovation projects development and enterprise support to social enterprises.
Have knowledge and experience in entrepreneurship development and the respective stages of developing and growing startups
quality experience working with other UN agencies or similar organizations with similar operations.
be able to provide examples of past assessment of enterprise/entrepreneurship projects
be in a position to guarantee timely delivery of evaluation according to agreed timelines and deliverables
have multiple team members devoted to this project.
have knowledge and experience working in the East and Southern Africa Region.
Evaluation team
The evaluation team will be composed of a Team Leader and an Analyst.
Team Leader – Senior Evaluation Expert
The team leader must have extensive experience leading and conducting evaluations, including at UNFPA, as well as technical expertise in evaluation of social innovation/ evaluation of entrepreneurship projects.
The primary responsibilities will be:
Conducting and leading the evaluation in all its phases and managing the inputs of the analyst throughout the exercise;
Setting out the methodological approach;
Delivering the inception and final reports in line with the requested quality standards;
Presenting the results of the evaluation to stakeholders;
Assuring the quality of all deliverables.
Minimum qualification required:
Master’s degree or equivalent in development studies, sociology, economics, social studies, international relations or other related fields.
10 years of experience conducting or managing evaluations.
Experience conducting different types of evaluations with UNFPA.
Strong understanding of UNFPA’s policies and programming.
Proven skills in evaluation methodology, research analysis, including quantitative and qualitative data collection and analysis techniques.
Demonstrated expertise/experience in developing theories of change, results frameworks, and evaluation and monitoring systems;
Be fully acquainted with results-based management orientation and practices;
Excellent report writing skills, analytical skills, and computer skills.
Excellent command in written and spoken English.
Experience leading teams.
Team Member – Research Analyst
The team member will:
Contribute to the design of the evaluation methodology;
Contribute to the reconstruction of the theory of change by assisting in the development of stakeholder mappings (based on innovation ecosystems);
Undertake the in-depth documentary review as per the guidance of the team leader;
Prepare inputs and make contributions to the evaluation deliverables;
Participate actively in the primary data collection process (conducting interviews and participating in focus groups);
Assist with the management of the datasets generated during the exercise;
Create a google folder with relevant documentation;
Participate in team meetings, including with stakeholders.
Minimum qualification required:
Master’s degree or equivalent in development studies, sociology, economics, social studies, international relations or other related field;
5 years of experience conducting research;
Experience in social innovation;
Experience participating in evaluation of social innovation;
Experience in development of stakeholder mappings and analysis;
Proven skills in, research analysis, including quantitative and qualitative data collection and analysis techniques;
Excellent report writing skills, analytical skills, and computer skills;
Excellent command in written and spoken English
Inputs / services to be provided by UNFPA or implementing partner (e.g support services, office space, equipment)
Budget
The budget for the evaluation is $36,500. This will cover the costs of the evaluation team's fees, travel expenses, and other related costs.
The evaluation will take place remotely from the consultants’ base location. Travel to regional and country offices is not anticipated for this assignment. UNFPA ESARO will support the evaluator to set up meetings with identified stakeholders at the country level including with external partners.
Payment schedule
The payment modalities shall be as follow:
25% on acceptance of the draft inception report
25% presentation of preliminary results of data collection phase
40% on acceptance of the draft final report
10% on presentation of the evaluation results (PowerPoint)
Note that no payment will be processed until the corresponding deliverables are formally approved by the evaluation manager.
Other relevant information or special conditions, if any
Application process:
Interested applicants are expected to submit as part of their applications:
A proposal and work plan of not more than 5 pages detailing (among other things) how the assessment will be delivered, previous experience and plans to meet the deliverables and timelines
CVs of evaluation team members. The Lead applicant is required to make a joint submission with an accompanying Research Analyst as One Application. This is to ensure complementarity and mutual accountability of the evaluation team
Links and examples of similar previous work conducted
Any other relevant information to support the application.
WARNING TO APPLICANTS
UNFPA does not charge any application, processing, training, interviewing, testing or other fee in connection with the application or recruitment process.