Result of Service
IV. EVALUATION PRODUCTS (FINAL DELIVERABLES) The following products must be delivered: i. Initial Evaluation Meeting: In this meeting, the evaluation methodology will be presented to UN-Habitat. The consulting person should adjust the methodology based on any observations made by the UN-Habitat team. The final methodology must be approved by UN-Habitat. o One week after the start of the contract. ii. Initial Evaluation Report (between 10 and 15 pages): The initial report should be conducted after the document review and based on the discussions held. It should be prepared before the evaluation begins. Once approved, it will become the key management document for guiding the evaluation process. The inception report shall include background and context, evaluation purpose and objectives, evaluation matrix, approach, including the Theory of Change, and methods, limitations to the evaluation, proposed outline of the evaluation report, as well as work schedule and delivery dates of key evaluation deliverables. o Delivery in the third week after signing the contract. o For the satisfactory delivery of product, 30% (twenty percent) of the total amount agreed in the contract will be paid. • Draft Evaluation Report (with the agreed-upon length): The program unit and key stakeholders of the evaluation should review the draft evaluation report and provide various comments to the evaluator within the agreed-upon timeframe, addressing the necessary content (as agreed upon in the terms of reference and in the initial report) and quality criteria, as indicated in these Guidelines. The draft should follow the structure outlined in the following section (Final Evaluation Report). o Two and half months after the signing of the contract. For the satisfactory delivery of product, 30% (forty percent) of the total amount agreed in the contract will be paid. • Final Evaluation Report. The report should be delivered three months after the contract is signed. Four weeks should be allocated for review, adjustments, and feedback on the final report, which should be submitted in the fourth month of the consultancy. For the satisfactory delivery of product, 40% (forty percent) of the total amount agreed in the contract will be paid. The final report of the evaluation must integrate at least the following elements: 1. Title and data about the project, being evaluated and the evaluation team. 2. Project and evaluation data, such as project title, budgets, project dates, and other essential data. 3. Table of Contents. 4. List of acronyms and abbreviations. 5. Executive Summary. A section of up to five pages that briefly includes the project to be evaluated, develops the purpose and objectives of the evaluation, including the evaluation audience and its use. Additionally, it describes key aspects of the approach and evaluation method, and summarizes the main findings, conclusions, and recommendations. 6. Description of the intervention being evaluated. It serves as a basis for readers to understand the design, the overall logical framework, the results framework (theory of change), and other relevant information about the initiative being evaluated. 7. Scope and objectives of the evaluation. To clearly explain the scope, main objectives, and fundamental questions of the evaluation. 8. Approach and methods of the evaluation. It describes in-depth the methodological approaches and the selected methods. 9. Data analysis. It describes the procedures used to analyze the collected data to answer the evaluation questions. 10. Findings and conclusions based on the criteria relevance, effectiveness, efficiency, sustainability, as well as with a gender and intersectional perspective. The evaluation findings are presented, based on the analysis of the collected data and the conclusions drawn from these findings. 11. Recommendations. The report should include a reasonable amount of practical and viable recommendations intended for the intended users of the report regarding the actions to be taken or the decisions to be made. 12. Lessons Learned and Good Practices. As appropriate and as stipulated in the terms of reference, the report should analyze the lessons learned from the evaluation of the intervention.
Duties and Responsibilities
I. BACKGROUND AND CONTEXT At UN-Habitat, we promote transformative change in cities and human settlements through knowledge, policy advice, technical assistance, and collaborative action, to leave no one and no place behind. Specifically, our focus is on five aspects: reducing spatial inequality and poverty in urban and rural communities; increasing shared prosperity in cities and regions; taking action for climate change and urban environment improvement; and promoting effective prevention and response to urban crises. In 2022, UN-Habitat and the National Workers’ Housing Fund Institute (INFONAVIT), through the Mesoamerica Office, entered into a collaboration agreement on housing, urban development, and the generation of spatial indicators to promote adequate housing conditions for all their beneficiaries and accredited members through the Project “Technical assistance to strengthen Infonavit’s actions on sustainable urbanization and adequate housing within the framework of the 2030 Agenda for Sustainable Development”. In this regard, the Project set out as general objective to provide technical assistance to the National Workers’ Housing Fund Institute (INFONAVIT) for the development of a set of strategic lines on urban planning, generation of urban-scale spatial indicators, and integration of value chains in the housing construction sector. II. PURPOSE, SCOPE, AND OBJECTIVES OF EVALUATION The current final evaluation of the Project aims to identify short, medium, and long-term results; analyze the causal logic and consistency in the project design; identify good practices and lessons learned in technical, management, and sustainability matters to strengthen future interventions. The evaluation will be carried out based on relevance, effectiveness, efficiency, and sustainability, as well as with a gender and intersectional perspective, following the criteria mandated in the section “Evaluation Questions based on Evaluation Criteria. The evaluation methodology should consider the present political and social landscape of Mexico, country in which was implemented the project, while also integrating qualitative and quantitative approaches. It must involve engaging key stakeholders of the Project, such as government counterparts, Civil Society Organizations, academia, the private sector, and subject matter experts. It is important to mention that both the methodology and the involvement of stakeholders will be determined collaboratively with the UN Habitat Project team and may be adjusted according to their needs and preferences. The final evaluation is also aligned with the UN-Habitat evaluation policy and framework, where projects with a budget of USD 1 million or more should be evaluated by external evaluation experts who were never involved in the planning or implementation of the program. For further reference, please refer to the UN-Habitat Evaluation Manual. It’s worth noting that the project conducted an internal evaluation aimed at identifying results, lessons learned, and good practices of the Project in terms of relevance, effectiveness, and sustainability, with gender perspective and intersectionality. During the internal evaluation interviews were carried out with the Technical Team of UN-Habitat and Infonavit, as well as a survey and a focus group with a sample of the participating municipalities. In this regard, the final evaluation should ensure not to duplicate aspects already reviewed, unless it can complement or strengthen the findings. Evaluation Questions based on Evaluation Criteria The methodology of the Final Evaluation should take into account the following evaluation questions, bearing in mind that these are guiding and can be supplemented jointly with the UN Habitat Project team. Relevance 1. Is the consistency of the intervention with programmatic priorities, as well as national needs, INFONAVIT, municipalities, and indirect beneficiaries clear? What elements need to be strengthened? 2. To what extent is the design of the intervention coherent? Consider: justification for the creation and design of the program; diagnosis and identification of the problem (assessment of the program design regarding the addressing of the problem or need); gender and intersectional perspective; populations (consider intersections) and attention mechanisms; causal logic and integrality between components and activities; coverage and targeting mechanisms, and results indicator matrix. 3. Have the priorities of the beneficiary institutions/governments changed since the definition of the intervention? If so, how was the intervention adapted to these changes? 4. Has the project demonstrated adequate responsiveness to political, legal, economic, institutional changes, etc., in the country? 5. Were lessons learned from other relevant projects taken into account when designing the project? 6. With which programs and/or development actions implemented by UN-Habitat, other UN agencies and programs, as well as other actors, could the Project have complementarity and/or similarities? Effectiveness 1. To what extent were the expected results of the intervention achieved? 2. To what extent did the project generate positive results in the short, medium, and long term? 3. To what extent were positive impacts, changes, or transformations achieved in INFONAVIT, the beneficiary municipalities, and indirectly benefited individuals? Have any unforeseen effects been realized? 4. Have there been any unforeseen negative impacts on INFONAVIT, the municipalities, and indirectly benefited individuals? 5. To what extent did the Project benefit women, girls, and vulnerable groups? To what extent did the project integrate root causes of inequality between women, girls and vulnerable groups? 6. Have relevant actors in the Project encountered difficulties accessing the intervention activities? 7. To what extent did the project communicate strategic results to counterparts and in the media? How could this aspect be strengthened? Efficiency 1. What level of efficiency did the structure defined for project management in the project document demonstrate in achieving the expected results? 2. To what extent were financial and human resources used economically? Were resources (funds, human resources, time, specialized knowledge, etc.) strategically allocated to achieve the effects? 3. To what extent did institutional collaboration and articulated management mechanisms contribute to achieving the intervention’s results? 4. Did the M&E systems employed ensure the effectiveness and efficiency of project management? 5. To what extent were resources allocated with a gender and intersectionality perspective? Sustainability 1. To what extent will financial and economic resources be available to maintain the benefits achieved through the project? 2. Are there any social or political risks that could jeopardize the sustainability of the project’s products and its contributions to the country’s program products and effects? 3. Are there mechanisms, procedures, and policies for key stakeholders to continue working on the results achieved in the areas of gender equality, women’s empowerment, rights, and human development? 4. What is the level of support/appropriation of results by stakeholders towards the project’s long-term objectives? How can this aspect be strengthened? 5. To what extent were synergies between allies leveraged for the Project’s sustainability? How can this aspect be strengthened? 6. Do UN-Habitat interventions have well-designed and planned exit strategies? What could be done to reinforce exit strategies and sustainability? III. EVALUATION APPROACH AND METHODOLOGY The evaluation will be conducted in line with the United Nations Evaluation Group (UNEG) Norms and Standards for evaluation in Nations System. The evaluation methodology should consider the current political and social context of the country, as well as integrate qualitative and quantitative methods, incorporating relevant actors of the Project, including government counterparts, Civil Society Organizations, academia, the private sector, subject matter experts, and the project team. It should be noted that the actors will be established jointly with the UN Habitat Project team and may be modified based on its needs and requests. Gender and intersectionality perspectives should be ensured to be incorporated in all aspects of the evaluation methodology. Additionally, the use of virtual platforms and field visits may be considered in the evaluation methods. In this regard, the methodology should consider the following elements: • Cabinet review of all available project documentation. The documentation will be provided by the UN-Habitat Project team. • Semi-structured interviews. • Focus groups. • Review and analysis of data. It is necessary to achieve maximum validity and reliability of the data (quality) and promote its use; the evaluation team will be responsible for triangulating the various data sources. • Analysis Methods. It may be propose appropriate analysis methods to assess the project’s impact on INFONAVIT, municipalities, and indirectly benefited individuals. In this regard, including comparative methods, quasi-experimental designs, among others, is encouraged.
Qualifications/special skills
• Required: Postgraduate and university degree (stricto sensu) in fields related to public policy, project evaluation, urban development, economics or related. Or additional 6 years of relevant experience to the post, beyond the requirement. • Desirable: If you have published bibliographic material on the aforementioned topics, you must indicate it in your application, and it will be positively taken into account. Demonstrate at least 8 years of professional experience in the social evaluation of projects, programs, or public policies at the local, state or national level; project management or administration development; management and implementation of public policy projects, preferably from the urban or territorial sphere, or related professional experience. o Experience of 2 years in evaluations with a gender and intersectionality perspective. o Demonstrate relevant professional experience in the implementation of diverse quantitative and qualitative techniques for the evaluation of projects or programs, including comparative and quasi-experimental methods. • Experience in the Mexican context is mandatory. • Demonstrating knowledge of the 2030 Agenda and the New Urban Agenda, and/or UN-Habitat language is desirable. International experience will be positively considered, particularly in the field of international cooperation for territorial and urban development. Work experience in the United Nations System is not a requirement, but it will be positively valued.