Advanced Monitoring Evaluation and Learning Systems Training Course

Participants can construct a testable theory of change and aligned results framework.

• Theory of Change pathways linking interventions, behavioural changes, and outcomes
• Results chains linking activities, outputs, outcomes, impact, and critical assumptions
• Problem tree analysis separating root causes, effects, stakeholders, and constraints
• Causal assumptions tested for plausibility, evidence strength, and contextual sensitivity
• Logical Framework Approach aligning objectives, indicators, means, and external conditions
• Contribution logic distinguishing programme influence from direct attribution claims

Participants can specify useful, feasible and auditable indicators for programme results.

• SMART indicator tests applied beyond simple output counting requirements
• Indicator reference sheets defining purpose, unit, formula, source, frequency, responsibility
• Disaggregation matrices covering sex, age, disability, location, and relevant groups
• Proxy indicators selected when direct measurement is infeasible or unethical
• Numerator and denominator rules preventing inconsistent rate and ratio calculations
• Performance indicator tracking tables linking targets, actuals, variance, and commentary

Participants can establish credible baselines and set defensible targets using available evidence.

• Baseline study purposes distinguished from needs assessments and formative research
• Target-setting methods using historical trends, benchmarks, capacity, and risk assumptions
• Trajectory charts showing expected progress, seasonal variation, and implementation milestones
• Baseline sampling frames defining populations, units, coverage, and exclusion criteria
• Scenario analysis testing target feasibility under alternative funding and access conditions
• Target revision protocols documenting rationale, approval authority, and reporting implications

Participants can develop an integrated monitoring plan with practical data collection procedures.

• Monitoring plans sequencing routine data, surveys, observation, and feedback channels
• Data collection calendars aligned with implementation milestones and reporting deadlines
• Source triangulation combining administrative records, respondent data, and direct observation
• Field protocols specifying enumerator conduct, consent, referral, and escalation procedures
• Tool piloting criteria covering comprehension, burden, sensitivity, and recording errors
• Mobile data collection workflows using validation rules, skip logic, and timestamps

Participants can establish controls that test the accuracy, completeness and integrity of MEL data.

• Data quality dimensions covering validity, reliability, precision, integrity, and timeliness
• Data Quality Assessment procedures tracing reported figures to source documents
• Verification plans defining samples, evidence trails, reviewers, findings, and corrective actions
• Range checks, duplicate detection, missingness analysis, and outlier investigation procedures
• Spot checks comparing field observations, registers, interview records, and databases
• Corrective action logs assigning owners, deadlines, verification, and closure evidence

Participants can design proportionate data governance arrangements for sensitive programme information.

• Data management plans defining collection, storage, access, retention, and disposal
• Informed consent procedures addressing voluntary participation, risks, and withdrawal rights
• Data minimisation principles limiting personally identifiable information to necessary fields
• Role-based access controls separating data entry, analysis, approval, and administration
• Protection impact screening for sensitive populations, safeguarding, and security risks
• Anonymisation techniques removing direct identifiers and reducing re-identification risks

Participants can analyse routine monitoring data and communicate material performance patterns.

• Descriptive statistics summarising central tendency, spread, distribution, and missing data
• Cross-tabulation analysis comparing results by sex, age, location, and participant group
• Trend analysis separating programme progress, seasonality, shocks, and reporting changes
• Variance analysis comparing actual results against targets, plans, and prior periods
• Confidence intervals interpreted for survey estimates and decision-making limitations
• Dashboard specifications prioritising exceptions, trends, disaggregation, and management actions

Participants can select, manage and interpret qualitative evidence for programme learning.

• Key informant interview guides structured around experience, change, causation, and recommendations
• Focus group protocols managing participation, power dynamics, confidentiality, and consent
• Purposive sampling selecting information-rich cases, contrasts, and underrepresented perspectives
• Thematic coding frameworks combining deductive questions with inductive emerging themes
• Matrix analysis comparing respondent groups, locations, mechanisms, and contradictory evidence
• Sensemaking sessions testing interpretations against field knowledge, data, and assumptions

Participants can frame evaluations that answer decision-relevant questions with appropriate methods.

• OECD DAC criteria applied to relevance, coherence, effectiveness, efficiency, impact, sustainability
• Evaluation questions prioritised by decisions, users, uncertainty, and evidence gaps
• Evaluation matrices linking questions, indicators, sources, methods, and analytical approaches
• Process evaluation designs examining implementation fidelity, reach, mechanisms, and context
• Quasi-experimental options including comparison groups, matching, difference-in-differences, and regression
• Theory-based evaluation testing causal mechanisms, assumptions, and contribution claims

Participants can develop sampling plans and fieldwork controls proportionate to evaluation purpose.

• Probability sampling methods covering random, systematic, stratified, and cluster selection
• Sample size considerations balancing precision, subgroup analysis, resources, and response rates
• Non-probability sampling justified for purposive, snowball, quota, and case selection
• Sampling error, nonresponse bias, coverage error, and measurement error distinguished
• Enumerator training plans addressing tools, ethics, probing, recording, and safeguarding
• Field supervision protocols using back-checks, accompaniment, review, and escalation

Participants can integrate affected-population feedback and accountability measures into MEL systems.

• Community engagement channels selected for accessibility, safety, confidentiality, and responsiveness
• Complaints and feedback mechanisms categorising queries, concerns, allegations, and requests
• Accountability to Affected Populations indicators measuring participation, information, and response
• Humanitarian response monitoring tracking coverage, timeliness, appropriateness, and protection risks
• Referral pathways linking sensitive feedback to safeguarding and protection focal points
• Closing feedback loops by documenting response, communication, satisfaction, and unresolved issues

Participants can document and assess outcome-level changes where pathways are complex or emergent.

• Outcome Harvesting steps identifying changes, substantiating evidence, and assessing contribution
• Change statements specifying who changed what, when, where, and significance
• Substantiation interviews testing outcome claims through independent knowledgeable sources
• Contribution Analysis assessing causal claims against alternative explanations and evidence
• Process tracing tests examining necessity, sufficiency, sequence, and competing hypotheses
• Evidence rubrics rating confidence, corroboration, relevance, and limitations transparently

Participants can establish learning processes that connect evidence to accountable programme adaptation.

• Learning agendas framing priority uncertainties, users, evidence needs, and decision timing
• After-action reviews documenting expectations, events, causes, lessons, and follow-up actions
• Pause-and-reflect sessions linking monitoring findings with implementation decision points
• Adaptive management logs recording changes, evidence, authority, rationale, and consequences
• Decision registers distinguishing operational adjustments, design amendments, and strategic choices
• Knowledge products tailored as learning briefs, decision notes, and implementation guidance

Participants can govern MEL responsibilities across delivery partners and reporting requirements.

• Partner MEL capacity assessments identifying systems, staffing, tools, and support priorities
• Reporting protocols defining indicator ownership, submission schedules, validation, and approvals
• Data-sharing agreements addressing purpose, confidentiality, access, retention, and responsibilities
• Subaward MEL requirements balancing accountability, feasibility, and partner ownership
• Donor reporting narratives connecting results, variance explanations, evidence, and corrective action
• Steering committee terms defining evidence review, decisions, escalation, and accountability

Participants can commission and manage useful, ethical and credible evaluations.

• Terms of reference specifying purpose, scope, questions, methods, deliverables, and governance
• Evaluator selection criteria assessing independence, methodological capability, sector knowledge, and ethics
• Inception report reviews testing design logic, sampling, tools, workplan, and risks
• Evaluation quality assurance using methodological review, evidence tracing, and factual checks
• Management responses assigning actions, owners, deadlines, resources, and progress reporting
• Evaluation dissemination plans identifying users, messages, formats, timing, and safeguards

Participants can communicate evidence clearly for operational, governance and donor decisions.

• Evidence narratives distinguishing findings, interpretations, conclusions, recommendations, and management actions
• Data visualisation selection matching charts to comparisons, trends, distributions, and relationships
• Disaggregated reporting avoiding misleading averages and unsupported subgroup claims
• Traffic-light systems paired with thresholds, explanatory notes, and action triggers
• Learning briefs presenting decision context, evidence, implications, options, and next steps
• Uncertainty communication stating limitations, confidence, bias risks, and evidence gaps

Participants can resource a MEL system realistically and plan for continued use after project closeout.

• MEL budgets allocating staff, data collection, systems, evaluations, learning, and assurance
• Cost drivers compared across routine monitoring, surveys, evaluations, and verification visits
• Value-for-money considerations balancing information usefulness, cost, burden, and timeliness
• Capacity development plans combining mentoring, standard procedures, coaching, and performance review
• System sustainability assessments examining institutional ownership, financing, skills, and data use
• Closeout plans preserving datasets, documentation, learning products, and handover responsibilities

Participants can identify and manage threats to evidence quality, participant safety and system continuity.

• MEL risk registers identifying threats, likelihood, impact, controls, owners, and triggers
• Access constraints managed through contingency methods, remote monitoring, and verification alternatives
• Political economy analysis identifying incentives that distort reporting and evidence use
• Safeguarding risk controls embedded within data collection, feedback, and referral processes
• Fraud risk indicators examining duplicate beneficiaries, inflated outputs, and altered records
• Business continuity plans protecting critical data, reporting cycles, and decision forums

Participants can align MEL activities with programme design, implementation, review and closeout decisions.

• Design-stage evidence plans informing targeting, intervention selection, and baseline requirements
• Inception-phase tasks finalising indicators, tools, roles, budgets, and data protocols
• Quarterly performance reviews linking implementation evidence with management decisions and actions
• Midterm review processes assessing relevance, delivery quality, outcomes, and required adaptations
• Closeout evidence packages documenting results, lessons, sustainability, and outstanding commitments
• Portfolio analysis comparing programme performance, learning themes, risks, and resource decisions

Participants can build, review and present a complete MEL system package for a defined programme.

• Programme case definition specifying objectives, stakeholders, constraints, risks, and decisions
• Results framework integrating theory of change, indicators, assumptions, and measurement priorities
• Costed MEL plan covering monitoring, evaluation, learning, governance, and data assurance
• Data quality protocol defining verification methods, evidence trails, corrective actions, and accountability
• Learning agenda connecting priority questions, review forums, decisions, and adaptation records
• Peer review against feasibility, ethics, usefulness, evidence quality, and implementation readiness