Consultancy to Support External Evaluation of Serve Project

Objectives and Specific Tasks to be Undertaken by the Consultant(s)

The evaluation will use a mixed methods approach, integrating both quantitative and qualitative data. The evaluation will be anchored on the OECD-DAC criteria as presented above and led by an external consultant/firm.

The evaluation methodology will encompass, but is not limited to, the following:

Review all quantitative data on program indicators, including a comparison of baseline and end-line data, and analyze this data about the evaluation questions outlined above. Additionally, the evaluators will examine performance monitoring data collected throughout the BHA awards to evaluate the systematic implementation of results-based monitoring within the awards. This analysis will be based on data collected by Concern throughout the awards; hence, no further quantitative data will be collected.

The external evaluators will lead the qualitative data collection to address the evaluation questions using Focus Group Discussions (FGDs) with program participants and Key Informant Interviews (KIIs) with staff and stakeholders. The qualitative approach will also explore issues identified in the quantitative review, focusing on the effectiveness of the FCRM system, the sustainability of food assistance, agriculture (particularly livestock), WASH, nutrition, and barriers faced by men, women, and marginalized groups. This process will consider societal structures, demographics, and gender and age factors to inform future program design.

The sampling approach for primary data collection will be non-probabilistic and purposive, aligning with its qualitative focus. This approach aims to capture a diverse range of perspectives on specific aspects of the implementation of the Awards. The evaluation team is encouraged to propose a sampling strategy with distinct samples for focus group discussions in each sectoral intervention (Food Assistance, Agriculture, Nutrition, and WASH). The strategy must ensure the inclusion of female participants and Marginalized groups. The team should determine a sample size sufficient to achieve saturation on the evaluation questions, based on their analysis of the project and scope of work. The evaluation team is encouraged to propose a purposive sampling approach for staff and stakeholder interviews to achieve saturation on the evaluation questions. Concern will fully support and facilitate the sampling process to ensure the effective collection of evaluation data.

Desk-based research/preparation

The evaluation team will review program documents, including proposals, progress reports, monitoring records, and distribution data, alongside Concern’s quantitative data aligned with BHA indicators. They will also analyze reports from other humanitarian organizations and sector-specific documents, such as SMART Survey Reports, Rain Assessment Reports, National Drought Management Bulletins, Disease Surveillance Reports, and Kenya Health Demographic System reports for Food Assistance, WASH, Agriculture, and Nutrition sectors.

Industries:Non-profit Organization Management

Function: Others