Introduction & Background

FCA Ukraine country office is looking for service providers/consultants for ‘Comprehensive Impact Assessment of Psychosocial Support (PSS) Activities in Ukraine during the escalated conflict since 2022’ under/as part of FCA Ukraine CO since 2022 in Chernihiv and Kharkiv Regions.

Background info on FCA

FCA is the largest Finnish development and humanitarian cooperation non-governmental organization. FCA operates in 12 countries around the world and specializes in three thematic priority areas: Right to Peace, Right to Livelihood, and Right to Quality Education. Right to Quality Education is a key focus area for FCA global programs and in Ukraine. We work with people in need, regardless of their religious beliefs, ethnic background or political convictions for more information, please visit www.kua.fi

Background info on FCA CO requesting the services

Right to Quality Education is a key focus area for FCA global programs and in Ukraine. Right to Quality Education is a key focus area for FCA global programs and particularly in Ukraine.

FCA is an active member of the Global Education Cluster, Inter-Agency Network for Education in Emergencies (INEE) Steering Group, and UNESCO Teacher Task Force. FCA contributes to improved access and better quality of learning through four strategic focus areas, namely: Education in Emergencies (EiE), Technical and Vocational Education and Training (TVET), Linking Learning to Earning (LL2E), and Education Sector Development & Teacher Education.

Following the escalation of conflict in February 2022, FCA established a presence in Ukraine and started Education in Emergencies programming, focusing on enabling physical access to education and addressing the psycho-social needs of children and teachers. FCA has worked closely with the Ministry of Education, education authorities at the oblast and hromada levels as well as local NGO partners. As of June 2024, FCA Ukraine’s education activities have benefitted over 41,000 students and teachers. These activities have included school and shelter rehabilitation, equipping shelters, distribution of learning kits, teacher training, psychosocial support (PSS) activities, as well as the organization of summer camps and student clubs.

FCA is currently leading two consortia, the ECHO-funded Safe Return to Learning project (20M euro) with Save the Children and People in Need, and the Education Cannot Wait-funded consortium with 3 local NGOs (Go Global, Doccu, MriyDiy). Both projects have strong teacher training components. FCA Ukraine has 33 full-time staff (28 local, 5 international). FCA’s head office in Helsinki provides support in the form of Finnish education expertise.

FCA was among the first INGOs working on Education in Emergencies after the start of the Russian invasion in February 2022, playing a key role in establishing the Education Cluster in Ukraine and chaired the Northern Ukraine Education Sub-cluster. FCA also plays an active role in the Protection, Food Security and Livelihoods, Shelter and NFI clusters and the Advocacy Working Group and has signed an MOU with the Ministry of Education and Sciences (MoES).

Finn Church Aid implemented projects/activities on PSS to date

ECHO PROJECT: Safe Return to Education (2022-ongoing)

Project Objective: To ensure access to education for conflict-affected children in Chernihiv and Kharkiv regions by supporting formal schools, Temporary Learning Spaces, Digital Learning Centres, and ensuring that teachers are capacitated in key priority issues including Psychological First Aid (PFA), Teacher Wellbeing and Social and Emotional Learning (SEL). Child Protection is mainstreamed throughout by including recreational and PSS activities for children, alongside the use of Child Protection referral mechanisms and appropriate trainings for teachers and caregivers.

Chernihiv:
FCA has reached 233 adults (26 men, 207 women) with PFA trainings and 10 adults (1 man, 9 women) with SEL. Teacher well-being activities were provided to 207 teachers (11 men, 196 women) during the reporting period. The Safe Space Psycho-Social Support (PSS) program for children has reached a total of 1023 students (531 boys, 492 girls).

Kharkiv:
As part of the Safe Space PSS program in Kharkiv, from September 2023 to June 2024, mobile teams provided psychological assistance and support to 2109 students (1012 girls, 1097 boys) aged 6-14 (primary school – 1362 students: 647 girls, 715 boys; secondary school – 747: 365 girls, 382 boys). In metro schools, 695 children were reached (338 girls, 357 boys). The program covered 19 educational locations and formed 139 groups of schoolchildren.

The Teachers’ Wellbeing Program covered 6 locations in Kharkiv and conducted cycles of classes for 6 groups of teachers. In each group, 9 sessions were held (including 4 workshops and 5 sessions on experience exchange). The total number of beneficiaries reached was 119 teachers aged 22 to 65 (92 women and 7 men). During the course, they were able to master the ability to manage their own emotions, identify individual values and take actions to realize them, mastered coping mechanisms and self-care strategies. At the end of the course, participants highly rated their confidence in the knowledge they had gained.

As a part of the PFA training, 127 participants were trained: 117 were women and 10 were men aged 25-56. Of these, 103 were teachers (96 women and 7 men) and 24 were parents (21 women and 3 men).

ART THERAPY project

Dates: June 6, 2023 – April 6, 2024
Location: Kyiv

Project Objective: The goal was to improve the well-being of Ukrainian children aged 4-16 through alternative methods. Art therapy benefits include helping children express their negative emotions such as fear, anxiety, and insomnia through art, guided by professional art therapists.
Beneficiaries: 101 children (46 boys, 55 girls), including children with disabilities, from large families, children of veterans, and IDPs

Activities:
There were 3 rounds of classes conducted within the stated period. Each round had 10 classes. The first and second rounds involved children aged 4-16 who were divided into 4 groups by age (4-6 years old, 7-9 years old, 10-12 years old, 13-16 years old). The third round of classes had only 3 groups (4-6 years old, 7-9 years old, 10-12 years old). The classes took place once a week, either on Saturday or Sunday.

Outcomes:
101 children completed the program, 11 groups were formed, and 110 classes were conducted. Parents reported that their children became less anxious and more focused. Another benefit was socialization, which children lack during online studying.

PSS AND SEL TRAINING AND SUPPORT PROGRAMME FOR UKRAINIAN SCHOOLS

Dates: August 17, 2023 – January 31, 2024
Location: Kharkiv and Chernihiv regions

Project Objective: The goal was to launch the MHPSS model in Ukrainian schools and unite efforts of school administration, teachers, and school psychologists to provide efficient mental health support to students.
Beneficiaries: 20 schools (10 from Kharkiv region and 10 from Chernihiv region), 40 teachers and school psychologists (10 teachers and 10 psychologists from Kharkiv region and 10 teachers and 10 psychologists from Chernihiv region). Each school was represented by 1 psychologist and 1 teacher.

Activities:
There were two groups of trainees: one group consisting of 20 people from Kharkiv region, another one consisting of 20 people from Chernihiv region. Both groups had 5 online classes on the MHPSS model at school. During classes, the participants considered topics such as stress, trauma, bullying, suicidal behavior, self-regulation, and relaxation techniques. The participants received an MHPSS manual developed specifically for this project, covering both theory and practice. After completing the online classes, the groups had 1 offline ToT class, where the participants learned how to develop a training course and model on the MHPSS model and implement it in their schools. The participants not only completed the course but also agreed to cascade the training in 2 schools (theirs and one optional).

Outcomes:
Direct beneficiaries included 20 schools (10 in Kharkiv region, 10 in Chernihiv region), 20 teachers (10 in Kharkiv region, 10 in Chernihiv region), and 20 psychologists (10 in Kharkiv region, 10 in Chernihiv region). Two training courses were conducted (1 for Kharkiv region schools, 1 for Chernihiv region schools).

KOLO CLUBS 2.0

Dates: February 15, 2023 – December 21, 2023
Location: Chernihiv region

Project Objective: To support formal and non-formal education systems in territorial communities of Chernihiv Oblast by increasing the capacity of teachers and education managers at the secondary school level to organize the educational process in emergency situations. The project also aimed to provide support to children and their parents through extracurricular activities aimed at MHPSS, first aid, mine safety, behavior during evacuation and in bomb shelters, development of civic and social competencies, and other competencies according to the New Ukrainian School reform.

Beneficiaries: Three communities in Chernihiv oblast, namely, Kulykivska, Mykhailo-Kotsiubynska, and Talaivska hromadas, and Chernihiv city community

Activities:
The project aimed at four main activities: extracurricular activities for children, MHPSS sessions for pupils and their parents, trainings for teachers, and renovation of educational spaces.

Outcomes:
3250 children attended extracurricular activities; 850 teachers were trained and practiced these methods with 8500 children; 590 parents were reached through psychosocial support groups; 4 permanent KOLO locations were launched in Chernihiv oblast; and 1 training center for teachers was launched in Chernihiv.

Description of the requested services

Introduction

There is currently a lack of robust assessments of PSS activities implemented in Ukraine since the escalation of the war in 2022 . Current available reports by different actors in the country tend to highlight the magnitude and types of services delivered and the need for more such services, without a more thorough study on whether the assistance offered is meeting the evolving humanitarian needs in relation to PSS.

In terms of notable assessments done to date on MHPSS and PSS in Ukraine, the 2015 PLOS Medicine study highlights the integration of MHPSS into humanitarian responses, presenting evidence-based practices for effective implementation. Columbia University’s 2016 evaluation of UNICEF’s CFS found positive impacts on children’s emotional well-being and safety. A 2017 paper in the International Review of the Red Cross discusses a three-tiered approach to MHPSS, emphasizing community engagement. The 2018 Cochrane Review evaluates the impact of psychosocial interventions on children’s mental health, noting reductions in trauma and anxiety symptoms. WHO/Europe’s 2019 evaluation of MHPSS services for refugees and migrants highlights best practices and challenges. These studies illustrated the critical role of PSS and MHPSS in mitigating the psychological impacts of war and supporting affected populations in their recovery and rebuilding efforts.

Description of service requested

This assessment aims to evaluate the effectiveness and impact of PSS interventions by FCA in Chernihiv and Kharkiv regions in Ukraine. While it examines specifically FCA activities to date, it also includes study of PSS provided by other actors – as it is likely the FCA was not the only actor providing PSS support in the sampled locations. The assessment aims to identify the most effective PSS approaches, practices and methods offering recommendations for future interventions by FCA and other stakeholders in terms of what works. This will be done by gathering and analyzing data and also success stories. It also provides for understanding what the current needs for PSS are in order to inform FCA activities going forward. It will provide FCA and other stakeholders insight into best practices and areas for improvement in PSS, contributing to effective PSS in the context of education in Ukraine during the ongoing crisis.

Target Locations to be Assessed:

• Chernihiv Oblast
• Kharkiv Oblast

Target Beneficiaries to be Assessed:

• Teachers
• Parents
• Children

Target PSS activities to be Assessed:

• Psychological First Aid training (PFA)
• Social and Emotional Learning training (SEL)
• PSS Mobile team support (Safe Space PSS program)
• Teacher well-being sessions
• Mine-risk education services (MRE)
• Art therapy for children
• MHPSS sessions for pupils and their parents under KOLO Clubs
• Any other PSS activities provided by FCA or other organisations in the targeted locations

Questions the assessment should aim to answer:

Effectiveness, Relevance, and Impact:

• Outcomes and Relevance: What specific outcomes have been achieved by the PSS activities in the targeted locations, and how well do these outcomes align with the needs of the target groups, local conditions, and institutional priorities?
• Effectiveness of Interventions: How effective have specific interventions, been in addressing mental health issues and the specific needs of the affected populations?
• Impact on Well-being and Coping Mechanisms: What measurable impacts have the PSS activities had on the mental health, psychosocial well-being, resilience, and coping mechanisms of the beneficiaries?

Quality, Adherence, and Accessibility:

• Adherence to Standards: To what extent do the PSS activities adhere to international standards and guidelines set by organizations such as WHO and UNICEF?
• Accessibility and Reach: How effectively are the PSS interventions reaching the intended beneficiaries, particularly vulnerable groups? What barriers, if any, have beneficiaries encountered in accessing PSS services?
• Comparison of Practices: How do the approaches and practices of different organizations compare and contrast in terms of quality, adherence, and accessibility?

Beneficiary Feedback, Satisfaction, and Community Participation:

• Perceptions and Satisfaction: What are the perceptions and satisfaction levels of the beneficiaries regarding the PSS services provided?
• Community Engagement and Participation: How effectively have the PSS activities engaged the local communities, and what is the level of community interest and participation in these activities?

Sustainability and Long-term Impact:

• Sustainability Strategies: What strategies have been implemented to ensure the sustainability of PSS interventions beyond the project duration?
• Long-term Impact: What is the potential long-term impact of these interventions on the psychosocial well-being of the affected populations?

Challenges, Lessons Learned, and Recommendations:

• Challenges and Gaps: What challenges have been encountered during the implementation of PSS activities, and what gaps exist in the current interventions?
• Lessons Learned: What lessons have been learned from the implementation of PSS activities, and how can these inform future interventions in conflict settings?
• Success Stories and Best Practices: Collect success stories and lessons learned, highlighting best practices and areas for replication or scaling up.
• Recommendations for Future Programming: Based on the assessment findings, what recommendations can be made for future programming, including areas for expansion, adaptation, or refinement?

Objectives & Deliverables

General Approach of the Assessment:

• The proposed assessment tools will be used to collect data to both outcomes and to the extent possible impacts particularly for Psychosocial Support (PSS) initiatives, outcomes refer to the immediate and short-term changes resulting from specific interventions, such as improved mental health symptoms or increased access to support services. Impact, on the other hand, encompasses the broader, long-term effects of these interventions, including enhanced overall well-being, community resilience, reduced stigma around mental health, and the establishment of sustainable mental health services.
• This assessment includes examining the activities implemented by FCA and evaluating the influence of related support provided by other actors to the population in selected location(s). Therefore, a percentage of respondents must be non-beneficiaries of FCA services.
• The tools will aim to have a representative sample of beneficiaries, including teachers, parents, and children. Attribution of outcomes and impact will be assessed through interviewing the beneficiaries and providing results for impact.
• Both quantitative and qualitative methods will be used to assess the impact of the intervention.
• The contractor will undertake the crucial responsibility of selecting the sampling methodology, guided by the FCA team. This decision will be influenced by various factors including the nature of the activity, the number of beneficiaries involved, and the specific communities being targeted in order to make the assessment as representative as possible
• The Assessment will be undertaken in close collaboration with the relevant staff of the projects, technical Advisor, and MEAL manager.

Phasing

The assignment will be undertaken in 4 key phases: preparation, implementation, data analysis, and reporting. The assignment will be completed after the presentation of results in a workshop. The specific activities include:

Preparation

• Kick-off meeting with FCA to clarify the process and mutual expectations.
• Review the interventions’ documents and identify the key requirements for the Assessment;
• Review the relevant data collected by the FCA Ukraine MEAL system.
• Interview key informants such as program coordinators, psychologists, and teachers to gather detailed information on the implementation process, challenges faced, and lessons learned.
• Identify and review available sources of secondary data and assess primary data collection requirements.
• Develop a comprehensive technical document detailing the assessment instruments (such as Surveys, FGDs, etc.), covering sampling methodology and statistical assessment criteria.
• Prepare the questionnaires and/or any other assessment tools, and the database system for data entry.
• The assessment tools should be comprehensive enough to cover the intervention PSS activities as outlined in the projects’ plans and Objectives/Outcomes level of FCA projects’ result frameworks.
• Establish proper data quality procedures (i.e. avoiding duplications and controlling data integrity issues);
• Prepare an outline for the final report for the outcomes of the assessment.

Implementation

• Undertake a pilot survey in one of the selected locations to test the methodology and questionnaire.
• Review the methodology/questionnaire in consultation with relevant FCA staff, making adjustments as necessary.
• Conduct field visits and manage the necessary processes for data collection and implementation of assessment tools.
• Coordinate data collection work and ensure full compliance with the data entry protocols, data privacy, and protection rules.
• the assessment process should respect ethical best practices in terms of obtaining consent from interviewees and respecting their right to privacy.

Analysis

• Analyze and interpret the data/information collected using the assessment tools, considering the results from the perspective of data triangulation.
• Prepare a draft report based on the submitted outline during the preparation phase. Modify and amend the report as necessary based on the feedback from FCA.

Final report and workshop

• The Final Assessment Report will be submitted in English.
• The Assessment results should be presented to the FCA relevant staff.
• Provide all reports, collected data, transcripts, and other relevant materials and information to FCA.

Main Deliverables

• Assessment Inception Report – to be submitted within two calendar weeks of the date of contract signing. This report will include a fully elaborated Assessment proposal including the approach and proposed survey instruments, sampling frames, and sampling methodology, interviewing method, number of FGDs and the number of participants and locations, draft questionnaires and other survey tools, data processing, and analysis methodology, outline of the final report and schedule of activities.
• Pilot Survey Report – to be submitted within three calendar weeks of the date of contract signing. This report will provide the results of a small pilot survey together with proposed changes to the survey instrument and questionnaire.
• Draft Assessment Reports – to be submitted within six calendar weeks of the date of contract signing.
• Final Assessment Reports – to be submitted after one calendar week of the date of submission of the draft Assessment report. The final reports should be written in a clear and simple style, documenting the results of the Assessment following the above terms of reference. The report will be written based on the submitted and approved outline during the preparation phase.
• Final Workshop – within one calendar week of the submission of the Final Assessment Report, the results should be presented to FCA staff and representatives of different partners and stakeholders.

Application procedure

Deadline for submission of offers is 05.09.2024 (UTC+03:00).

To download the complete tender dossier and submit your tender, please visit the link:_ [**https://tarjouspalvelu.fi/UX/TP/SiirryTarjouspyyntoon/?tpId=522846&p=1225**](https://tarjouspalvelu.fi/UX/TP/SiirryTarjouspyyntoon/?tpId=522846&p=1225)

Candidates must upload their offers via through the link above no later than the deadline as mentioned above. Any tenders received after the deadline will not be considered.

No tender may be changed or withdrawn after the deadline has passed.

The candidate shall bear all costs associated with the preparation and submission of the offer and the Contracting Authority will in no case be responsible or liable for these costs, regardless of the conduct or outcome of the procurement process.