Using Evaluation Evidence for Policy Analysts Training Course

Course overview

Policy analysts are frequently asked to turn evaluation reports, monitoring data, research findings and stakeholder evidence into defensible policy advice. The difficulty is rarely a lack of data; it is judging whether evidence is credible, relevant and sufficiently transferable to a proposed policy decision. Analysts must distinguish correlation from contribution, interpret mixed findings, identify uncertainty, and explain what the evidence does and does not support before ministers, senior officials, donors or programme boards act.

This course equips participants to appraise and use monitoring and evaluation evidence throughout the policy cycle. Participants apply an evidence-use framework, assess evaluation quality against OECD DAC criteria, test theories of change, interpret indicators and disaggregated results, examine causal claims, and synthesise qualitative and quantitative findings. They learn to construct evidence briefs, policy options papers and recommendation matrices that connect findings to feasible actions, implementation risks, equity implications and measurable policy decisions.

Delivered over five instructor-led days, the programme combines expert instruction with worked development and humanitarian cases, structured evidence clinics, group appraisal exercises and individual drafting. Participants work with evaluation excerpts, logframes, indicator dashboards and datasets in Excel and Power BI. They leave with a policy evidence-use pack: an appraisal checklist, evidence synthesis matrix, decision-ready policy brief and a 90-day plan for applying the methods to a live policy issue.

The course is designed for analysts working in government, international development agencies, humanitarian organisations, foundations and implementing partners who already encounter evaluation and monitoring material and need to convert it into clear, accountable policy advice.

Course objectives

By the end of this course, participants will be able to:

• Appraise evaluation reports using OECD DAC criteria, methodological quality checks and relevance tests
• Construct an evidence synthesis matrix that compares findings, limitations, populations and policy implications
• Interrogate theories of change to test causal pathways, assumptions and contribution claims
• Analyse indicator trends and disaggregated results in Excel to identify material policy signals
• Distinguish attribution, contribution and correlation when interpreting programme results
• Draft a decision-ready policy brief that links evidence, options, trade-offs and recommendations
• Apply equity and distributional analysis to determine who benefits, who is excluded and what evidence is missing
• Develop a 90-day evidence-use plan for embedding evaluation findings in a live policy process

Benefits of attending

Target competencies

Who should attend

• Policy Analysts — who must translate evaluation findings into recommendations for senior decision-makers
• Monitoring and Evaluation Specialists — who need their evidence products to influence policy and programme choices
• Programme Managers — who use performance evidence to revise interventions, allocate resources and defend priorities
• Government Planning Officers — who prepare evidence-based policy submissions and implementation plans
• Humanitarian Analysis Officers — who must use needs, response and outcome data under operational uncertainty
• Donor and Portfolio Managers — who assess whether evaluation evidence justifies continuation, adaptation or scale-up

Requirements and prerequisites

Participants should have practical experience reading monitoring reports, evaluation reports, research summaries or programme performance data. Familiarity with results frameworks, logframes, indicators, baselines, targets and basic descriptive statistics such as percentages, averages and trends is assumed. Participants should be comfortable working with tables in Microsoft Excel; advanced statistical modelling, coding and Power BI expertise are not required. The course does not require participants to have commissioned an evaluation or to be professional researchers. Those new to monitoring and evaluation should first complete a foundation-level results-based management or evaluation course.

Training methodology

The instructor uses a live policy-evidence workflow rather than lecture-only delivery. Participants annotate evaluation excerpts against an appraisal rubric, rebuild a theory of change, analyse a small monitoring dataset in Excel and Power BI, and compare conflicting findings from humanitarian and development cases. Facilitated groups prepare option matrices and challenge each other's causal claims, assumptions and recommendation language. Daily feedback improves a progressively developed policy evidence-use pack. The final session is an application workshop in which each participant adapts the templates and methods to a current policy decision.

Course outline

Day 1: Framing policy questions and evidence needs

• Policy-cycle entry points for monitoring and evaluation evidence
• Decision-focused questions using the PICO and policy problem framing approach
• Evidence typologies: monitoring data, evaluations, research and administrative data
• OECD DAC evaluation criteria for policy relevance and utility
• Theory of change components, assumptions and causal pathways
• Evidence-use barriers in political and operational decision environments
• Evidence mapping and gap identification for a policy question

Workshop: Participants map the evidence available for a development or humanitarian policy case and produce a decision-focused evidence map with priority gaps.

Day 2: Appraising evaluation quality and causal claims

• Evaluation design selection: experimental, quasi-experimental, theory-based and qualitative approaches
• Internal validity threats including selection bias, confounding and attrition
• Attribution, contribution and plausible alternative explanations
• Sampling adequacy, measurement validity and data-quality assessment
• Qualitative credibility: triangulation, reflexivity and saturation
• External validity, transferability and context dependence
• Structured evaluation appraisal using a quality assessment checklist

Workshop: Participants appraise a published evaluation report using a structured rubric and produce a one-page judgement on the credibility and applicability of its findings.

Day 3: Interpreting monitoring data and synthesising findings

• Indicator reference sheets, baselines, targets and denominator checks
• Trend, variance and outlier analysis in Microsoft Excel
• Disaggregation by sex, age, disability, geography and socioeconomic group
• Data visualisation principles for policy decision-making in Power BI
• Reconciling conflicting quantitative and qualitative findings
• Evidence synthesis matrices for findings, certainty, limitations and implications
• Confidence statements and calibrated language for uncertain evidence

Workshop: Participants analyse a disaggregated programme dataset and evaluation excerpts to produce an evidence synthesis matrix and two decision-focused charts.

Day 4: Turning findings into policy options

• From findings to policy implications without overclaiming
• Policy option design using feasibility, effectiveness, cost and equity criteria
• Recommendation matrices linking actions to evidence strength and implementation risk
• Distributional and unintended-consequence analysis
• Stakeholder interests, political economy and evidence uptake
• Writing evidence summaries for ministers, boards and donor committees
• Citation, source transparency and handling contested evidence

Workshop: Participants convert a mixed evidence base into a scored policy option matrix and draft recommendations for a senior decision-maker.

Day 5: Producing decision-ready evidence products

• Policy brief architecture: issue, evidence, options, recommendation and next steps
• Executive-summary writing for evidence-constrained decisions
• Visual evidence communication with charts, tables and confidence cues
• Peer review against a policy brief quality checklist
• Responding to challenge questions on causality, cost and equity
• Embedding evidence checkpoints in policy development and programme governance
• Ninety-day evidence-use planning and stakeholder engagement

Workshop: Participants complete and present a decision-ready policy brief and a 90-day evidence-use plan based on a live or simulated policy issue.

Tools & standards covered

Microsoft Excel, Microsoft Power BI, KoboToolbox, OECD DAC Evaluation Criteria

A typical training day

Live online deliveries follow the same structure in the East Africa Time zone, with shorter screen blocks and longer breaks.

What the fee includes

How you can take this course

Certification

Participants who complete the full five days receive the Skillset Development Certificate of Completion, stating the course title, course code, dates and delivery format — suitable for professional-development records and employer reimbursement.

Frequently asked questions