Call for applications: Independent evaluation and impact assessment
EuroHealthNet is looking for an external evaluator to evaluate and assess the impact of EuroHealthNet programming, activities and the organisation as a whole, with a particular focus on activities and programmes supported by the European Social Fund Plus (ESF+) Grant (2022-2025). Apply by 9 September.
Call for applications
Independent evaluation and impact assessment of EuroHealthNet programming, activities and the organisation as a whole, with a particular focus on activities and programmes supported by the European Social Fund Plus (ESF+) Grant (2022-2025)
Terms of References
EuroHealthNet is a not-for-profit partnership of organisations, agencies and statutory bodies working on public health, disease prevention, promoting health and wellbeing, and reducing inequalities across Europe. For more information, please visit www.EuroHealthNet.eu.
EuroHealthNet is supported by a core grant from the European Commission, DG Employment and Social Affairs, through the European Social Fund Plus (ESF+). This grant supports a four-year framework (01/2022-12/2025) which is comprised of annual work-plans around achieving five specific objectives. Each specific objective will be implemented through a Work Package, led by our by our Core team, our three Platforms for Policy, Practice and Research, and by our Communications team.
Our specific objectives are to:
- Realise and expand a high-quality, effective and sustainable European Partnership for promoting social rights and health equity which engages a rich diversity of public authorities, civil society, and other key actors at EU, national, and local levels to concretely and directly contribute to the EU social policy objectives and related initiatives (including the green, digital and demographic challenges); (delivered by our Core team)
- Contribute to the implementation of the European Pillar of Social Rights (EPSR) principles and related initiatives at EU, national and local levels, and through concrete and direct support for the promotion of social rights and health equity in the European Semester process, including through the Recovery and Resilience Plans and achieve an Economy of Wellbeing; (delivered by our Policy Platform).
- Strengthen the capacities, competency and knowledge of national member organisations and stakeholders, facilitate the collection and exchange of good practices, and enable members to actively contribute to the implementation of the EPSR principles and related initiatives at EU, national and local levels, thereby reducing poverty, social exclusion, and health inequalities; (delivered by our Practice Platform).
- Monitor and assess the impact of evidence-informed policies and practices at EU, national, and local levels – using the Social Scoreboard and other indicators and targets contribute to the collective knowledge base of and data collection on policies and practices to reduce poverty, social exclusion and health inequalities; and enhance understanding of what’s required to achieve economies of wellbeing; (delivered by our Research Platform). This will help EuroHealthNet enhance relevant research and data availability and will support our policy, practice, and comms teams (expected impact 4)
- Organise communication and engagement activities internally and externally to raise awareness of the EPSR, promote social rights in Europe, combat poverty, health and social inequalities, and help address the green, digital and demographic challenges in an equitable way; increasing and improving dialogue between actors in Member States, citizens and the European Institutions; (delivered by our Communication Team).
Monitoring and evaluation are intrinsic to our activities. EuroHealthNet seeks to engage an external evaluator for the duration of the framework partnership agreement. The evaluator will perform constant evaluation and impact assessment of EuroHealthNet’s ESF+-related programmes, activities, as well as, when appropriate, the wider organisation, to monitor progress made towards achievement of its main organisational objectives, and to assess the impact of its work. The results will not only identify accomplishments but also generate knowledge on the shortfalls, thus contributing to lessons learned and informing organisational strategy, sustainability, and resource allocation. The evaluation and impact assessment will contribute to better-informed decision-making and promote greater accountability for performance in the coming years.
The four-year evaluation process will consist of the following:
1st year (2022): The evaluation work will begin with the development of the overall 4-annual evaluation and impact assessment plan and methodology. It will build on and take forward findings of the external evaluation from the previous periods (2014-2018) and (2018-2021). Output, outcome and impact indicators proposed by EuroHealthNet in the framework grant agreement proposal will be validated and/or adapted as needed by the external evaluator, and baseline data will be collected to support analysis of findings over the 4-year period. In 2022, the evaluator will also assess progress of the 2022 work programme for all specific objectives in all work packages (culminating in a 1st short report).
2nd year (2023): the work will concentrate on data collection and data analysis for 2023 and development of a 2nd short report. The evaluator is encouraged to select some of the guiding questions provided below as an area of focus.
3rd year (2024): involves data collection and data analysis for year 2024 and development of a 3rd short report. The evaluator is encouraged to select some of the guiding questions provided below as an area of focus.
4th year (2025): involves data collection and data analysis for year 2025 and development of a 4th annual short report. The evaluator is encouraged to select some of the guiding questions provided below as an area of focus. In 2025 a final 4-year impact assessment and public summary report should also be produced, including conclusions and recommendations drawn from the overall 4-year process. It will assess how the EuroHealthNet Partnership has made an impact through its policy advocacy, capacity building, project implementation, knowledge exchange activities by increasing engagement, expanding the partnership, and enhancing its visibility. This will inform EuroHealthNet’s decision-making on future policies, programmes, and strategies for sustainability beyond the FPA.
Evaluation and impact assessment plan
The 4-year evaluation and impact assessment plan, which will operationalise and direct the evaluation, should include, but not be limited to, a description of the framework, methodology, and timeline.
For the overall impact assessment, the evaluator should assess EuroHealthNet’s progress towards achieving the aims of its Strategic Development Plan (SDP) 2021-2026, specifically as they relate to the strategic objectives of our 4-year operating framework and the five areas of focus outlined in the SDP. Concretely, the impact assessment should answer questions regarding how the EuroHealthNet Partnership achieves change which promotes health and social rights and improves health equity and wellbeing at local, regional, national and European levels.
The impact assessment will be grounded in findings from annual evaluation exercises. The following elements are intended to support the development of annual evaluation plans.
A.-The evaluation (2022-2025) may use the following guiding questions to inform the impact assessment. For each question, the evaluator will need to think through a methodology, potential indicators and measurements:
- Member Satisfaction & Engagement: Do members still feel that EuroHealthNet is addressing their expectations and needs in policy, practice, and research? How well are EuroHealthNet’s activities and resources disseminated within member organisations? How well is the Executive Board, composed of members, integrated into wider activities, and is EuroHealthNet making the most of their knowledge, networks, etc.?
- Our activities and business plan: To what extent do activities for the ESF+ core grant, as well as our other project activities, align with the Strategic Development Plan and contribute to the achievement of strategic objectives? How coherent is EuroHealthNet’s presentation across these varied projects and how do they contribute to the overall visibility and reputation of the organisation?
- The EU Social Pillar: How have EuroHealthNet’s activities contributed to awareness of and engagement with the European Pillar of Social Rights?
- Communication and advocacy: How can EuroHealthNet effectively balance its messaging to convey both scientific rigor and political advocacy? Has EuroHealthNet’s visibility (vis-à-vis EU and national policy makers and national and regional health and wellbeing actors) increased over the period 2022-2025?
- Alliance-building: Could alliances be further leveraged to keep health equity on national and European policy agendas and reduce fragmentation? How does the memorandum of understanding with the WHO European Regional Office contribute to the achievement of strategic objectives?
B.- Framework of output and outcome indicators and measuring performance:
The evaluator will also need to evaluate outputs and outcomes using (intermediate) performance indicators to identify and assess proximal, distal, and consequential impacts of our work as part of the multiannual EaSI grant agreement. In order to do this, the evaluator will adopt quantitative and qualitative approaches, establishing output indicators, quantitative and qualitative targets and designing impact and outcome indicators and targets. The framework will be developed for the three Platforms and core functions. The information will be gathered in cooperation with office staff, analysed, synthesised in brief annual evaluation reports, and used for subsequent actions.
Examples are as follows:
|Expected Impact (linked to Specific Objectives)||Output indicators||Outcome and impact indicators and 2025 targets|
|Impact: Effective cooperation among public authorities, civil society and research bodies to exchange, design and implement.(Core team / Work Package 1)Linked to SO1 – Realise and expand a high-quality, effective, and sustainable European Partnership for promoting social rights and health equity||# General Council Meetings (GCM)# Policy & Strategy Meetings (PSM)# Executive Board meetings and calls# Annual external evaluation reports# Member recruitment and retention strategies with stated targets# New members||Sustainable attitude towards EuroHealthNet’s operations from GC, EB participants – Target: 90%Sustainable membership income: Growth in associated membership – Target: 20%Active engagement in EuroHealthNet strategy – Target: average of 75% of members represented in all PSM and GCMIncreased contact between members and national EaSI contact/focal points to scale up good practice – Target 75%|
|Impact: Stronger capacity of the network and the members to support policy making in the respective areas of the EPSR(Policy Platform / Work Package 2)Linked to SO2 – Contribute to the implementation of the EPSR principles and related initiatives at EU, national and local levels||# European Semester analyses# Responses to EU policy consultations and rapid policy briefs# Meetings with EU officials, other EU stakeholders and decision-makers (including speaking engagements)#events and activities with national, regional, local levels# Collaborations with other EU networks and alliances||Stakeholders and policy makers consider EU and (sub)national level social and health equity policy solutions to implement EPSR – Target: 60% indicate considerationMembers engaged in EU and national policy development – Target: 60% provided inputThe EPSR related policy proposals have been transferred among member institutions across MS – Target: 80% expressed added value|
|Impact: improved awareness about EU policies and funding among our members and increased capacity of EuroHealthNet to support policy making(Practice Platform, Work Package 3)Linked to SO3 – Strengthen the capacities, competency and knowledge of national member organisations and stakeholders||# Capacity Building Workshops# Country Exchange Visits# TWIGs# Response rate to member enquiries to the EuroHealthNet EU/European Funds Support Desk# Collaborations facilitated between EuroHealthNet members and other EU and (sub)national actors||Increased in depth knowledge on EPSR by members. Target 90%Use of new MFF and/or RRF funding at MS level by members. Target 80%Members consider themselves better informed to translate EU policy into local policy and practice – Target: 75%Members have taken actions forward as a result of the support, learning or info – Target: 60%|
|Impact: Enhanced research and availability of data that can be applied to generate effective action to reduce health inequalities.(Research Platform, Work Package 4)Linked to SO4 – Monitor and assess the impact of evidence-informed policies and practices at EU, national, and local levels||# European Public Health Conference & Gastein plenary sessions and workshops# New evidence shared on the Health Inequalities Portal# Collaborations with other research organisations and initiatives# data and evidence on health inequalities||Numbers of members taking steps to use Health Equity Impact Assessment methods more systematically – Target: 60%Page views of Health Inequalities Portal – Target: at least 50,000 page views per yearExternal stakeholders stress increased knowledge of data on health inequalities and interlinked social rights in their Member States- Target: 60%|
|Impact: Improved awareness about EU policies and funding and increased awareness about the needs and potential of EuroHealthNet(Communications team, Work Package 5)Linked to SO5 – Organise communication and engagement activities internally and externally||# Visits to the website# Publications of EuroHealthNet newsletters# Online Magazine# Social media fans, followers# Videos and multimedia published# Contacts in database||Impactful messages on issues of relevance to EPSR to act on social inclusion, social rights, health equity and wellbeing of vulnerable groups’ – Target: 230,000 page views of EuroHealthNet.eu in 2025 and over 15,000 contacts reachedIncreased visibility and awareness of network activities and EU added value to key stakeholders – Target: 35% increase since baseline in 2022|
Accountabilities and Responsibilities
EuroHealthNet’s Director and Programme Managers will oversee the evaluation process. The evaluator will report to the Executive Board of EuroHealthNet and present the results to the General Council.
The evaluator is responsible for: 1) designing and conducting the evaluation; 2) the day-to-day management of evaluation-related operations; 3) regular reporting on the progress; 4) the analysis and development of results; and 5) the production of deliverables in accordance with contractual requirements.
Process of Selection of the Evaluator
To respond to this call, the candidate evaluator must submit a short outline evaluation approach as described under the Evaluation Terms. The draft approach is to be submitted by Thursday, 5 May 2022.
The Executive Board of EuroHealthNet will review shortlisted submissions and select the most appropriate candidates for an interview with the Director and President of EuroHealthNet. The selection of the evaluator will be completed by 12 May 2022, and work can commence shortly thereafter.
We are seeking a professional evaluator:
- With proven record and extensive experience in monitoring and evaluation of organisations implementing EU funded projects.
- Skilled in going beyond the most immediate results of data analysis in order to provide timely evidence to underpin strategic guidance to help further improve governance and scale up work.
- Interested and experienced on health and social determinants of health, European policies and practices.
- Knowledgeable about European Pillar of Social Rights, the European Semester process, the WHO European Programme of Work (2021-2025), the Sustainable Development Goals, and related strategies, programmes and targets.
- Fluent in English (native speaker level). Knowledge of other European languages is an asset.
- Highly methodological and with excellent written skills.
The budget planned for the four-year work is 32 000 €, VAT included. In the first year the amount budgeted is 8 000 €.
Candidates meeting these requirements and interested to undertake this work should send their proposal together with their proven expertise as well as an outline describing their approach and their methodology to Renaud Rollet at email@example.com by Friday, 9 2022.