Evaluation Consultant

US-DC
3 weeks ago
Job ID
2017-2989
Category
US Based Positions

Overview

Consultancy Dates: November 1st, 2017 – August 31st, 2018 (maximum 80 days of work)

Location: D.C.-based with travel to up to 3 countries: e.g. Burma, Rwanda, and Ghana (to be finalized)

To Apply: Please send CV, writing sample, proposed daily rate/biodata

 

Background

The Maternal and Child Survival Program is a global, USAID Cooperative Agreement to introduce and support high-impact health interventions with a focus on 25 high-priority countries with the ultimate goal of ending preventable maternal and child deaths (EPMCD) within a generation. The Program is focused on ensuring that all women, newborns and children most in need have equitable access to quality health care services to save lives. The Maternal and Child Survival Program supports programming in maternal, newborn, and child health; immunization; family planning and reproductive health; nutrition; health systems strengthening; water, sanitation, and hygiene; malaria; prevention of mother-to-child transmission of HIV; and pediatric HIV care and treatment.

Contingent on funding, MCSP’s Monitoring, Measurement, Evaluation and Learning (MMEL) team seeks a short-term consultant to assist with implementing an evaluation method called a “contribution analysis” (CA) in up to three country programs, possibly including India, Burma, Madagascar, Ghana, Zambia or Rwanda.  The purpose of this method is to be able to document and highlight MCSP’s achievements at country level.  

Developed by John Mayne, contribution analysis[1] is a way to systematically explore cause and effect relationships between interventions and outcomes/impact, and can be done as part of a summative evaluation or prospectively in newer programs.  The use of this method is particularly useful in situations where the complexity of interventions, the existing systems, and lack of a counterfactual make it challenging to claim that the program has made a difference.  Using this method should help MCSP come to reasonably robust conclusions about the contribution that has been made based on well-articulated theories of change.

 

Consultancy Overview:

 The consultant will be tasked with implementing the six step CA process[2] which will require that multiple types of data, both qualitative and quantitative, are brought together to tell program’s story of contributions along a logical pathway to impact.

Data sources will include existing routine monitoring data; results from learning and research activities; documentation efforts (including case studies); results from impact modeling; and other existing data sources.  In some cases, the consultant will work with MCSP HQ and in-country staff to collect additional quantitative or qualitative data to obtain stakeholder perspectives.  The consultant will be expected to lead the development of a theory of change where one may not exist and then to use it as the framework around which the contribution analysis process will be organized. This will allow MCSP to document program achievements based on credible contribution claims.

 

 

[1] http://www.betterevaluation.org/en/plan/approach/contribution_analysis. Mayne, J. (2008) Contribution Analysis: An approach to exploring cause and effect, ILAC methodological brief, available at http://www.cgiar-ilac.org/files/ILAC_Brief16_Contribution_Analysis_0.pdf

[2] The six step CA process: 1.) setting the attribution problem to be addressed; 2.) developing a theory of change and risks to it; 3.) gathering existing evidence on the theory of change; 4.) assembling and assessing the contribution story and challenges to it; 5.) seeking out additional evidence as needed; and 6.) revising and strengthening the contribution story,) (Ibid).

Responsibilities

Key Activities and Deliverables

 

 

  1. Preliminary desk review of technical interventions in each country and evidence base for selected interventions that will be analyzed
  2. Drafting a country plan to include all needed materials for in country analysis, preparing agendas, workshop materials, etc.
  3. Preparation and modification of contribution analysis presentation tools for country staff to assist in stakeholder training
  4. Facilitation of stakeholder contribution analysis workshops
  5. Drafting a theory of change with country teams
  6. Desk review of data sources needed for CA and subsequent mapping to the theory of change
  7. Interim status reporting
  8. Production of case studies for each country where contribution analysis is conducted
  9. Presentation of CA case study to country teams and solicitation of input needed for revisions
  10. Revision of CA case studies as needed
  11. Development of a final presentation for each of the countries where contribution analysis took place for outward facing stakeholder events.

Deliverables

  • Final case study for each country that includes the theory of change and results of the analysis
  • Final presentation on CA process and results for each country

 

 

 

 

Required Qualifications

  • Master’s degree (Doctorate preferred) in evaluation methods, public health, evaluation
  • 12+ years' experience working in global health programs 
  • Demonstrated experience in evaluating complex public health programs, preferably in maternal and/or child health programs in low income settings
  • Strong facilitation skills and ability to engage stakeholders
  • Experience in working in Africa and Asia preferred
  • Knowledge of the foundations of program evaluation (as found in, for example, the Centers for Disease Control and Prevention Framework for Program Evaluation in Public Health, the American Evaluation Association’s Guiding Principles for Evaluators, etc.)
  • Direct program evaluation experience, including, but not limited to, developing logic models and theories of change for complex programs
  • Strong technical writing skills
  • Ability to clearly communicate assessment and contribution analysis results orally and in writing to a diverse group of stakeholders with different backgrounds
  • Availability during the performance period indicated with a willingness to travel for 2 week periods at a time internationally

 

Options

Sorry the Share function is not working properly at this moment. Please refresh the page and try again later.
Share on your newsfeed