Access to Justice Measurement and Evaluation Training Course

Participants can build a testable theory of change for an access-to-justice intervention.

• Problem trees separating immediate barriers from structural justice system constraints
• Causal pathways linking legal information, representation, procedures and remedies
• Assumptions tested through evidence, stakeholder insight and contextual analysis
• Results chains for legal aid, court reform and community dispute resolution
• External factors including security, political interference and enforcement capacity
• Contribution logic used where randomised attribution is impractical or inappropriate
• Outcome statements written around observable changes for justice seekers

Participants can develop indicators that measure reach, quality, equity and justice outcomes.

• Indicator selection criteria: validity, reliability, feasibility, sensitivity and utility
• Output, outcome and impact indicators aligned to a justice results chain
• Indicator reference sheets specifying numerator, denominator, source and frequency
• Service reach measures separated from population-level access and unmet need
• Quality indicators covering procedural fairness, respectful treatment and informed consent
• Disaggregation by sex, age, disability, location, income and legal problem
• Targets set using baselines, service capacity and plausible change assumptions

Participants can specify a proportionate legal needs survey for an intended measurement use.

• Legal needs survey design based on problem prevalence and resolution pathways
• Screening questions identify justiciable problems without relying on legal terminology
• Question modules capture advice seeking, costs, outcomes and satisfaction
• Probability sampling, purposive sampling and respondent-driven sampling compared
• Sample-size logic for estimating prevalence and subgroup differences
• Recall periods selected to balance memory error and problem coverage
• Cognitive testing and translation checks improve question interpretation

Participants can assess and use administrative data from justice institutions and providers.

• Legal aid registers examined for client profiles, case types and dispositions
• Court caseflow indicators measure filings, clearance rates, backlog and disposition time
• Police, prosecution and corrections data linked cautiously across justice pathways
• Unique identifiers, duplicate records and missing fields assessed before analysis
• Case closure categories distinguished from substantive resolution and remedy achievement
• Data dictionaries standardise variables across courts, providers and referral partners
• Administrative datasets triangulated with user surveys and qualitative evidence

Participants can analyse whether justice services produce equitable access and treatment.

• Equity analysis compares access, experience and outcomes between population groups
• Intersectional disaggregation identifies compounded barriers affecting justice seekers
• Procedural justice measures assess voice, neutrality, respect and trustworthy motives
• Accessibility audits cover disability accommodation, language, documentation and transport
• Gender-responsive indicators address safety, confidentiality and survivor-centred referral
• Data protection safeguards reduce risks from sensitive legal and personal records
• Participatory methods include community perspectives without compromising confidentiality

Participants can prepare a feasible monitoring plan with baseline and data-quality procedures.

• Baseline studies establish starting values before service expansion or reform
• Monitoring matrices assign indicators, responsibilities, sources, frequency and reporting users
• Data collection protocols define consent, storage, access and retention procedures
• Routine data-quality assessments test completeness, timeliness, accuracy and consistency
• Verification rules reconcile reported totals with source documents and case records
• Enumerator training addresses neutrality, trauma awareness and referral obligations
• Dashboard design matches indicator audiences, decisions and reporting cycles

Participants can select an evaluation design proportionate to a justice programme's decisions and constraints.

• Evaluation questions framed around relevance, coherence, effectiveness, impact and sustainability
• OECD DAC criteria adapted for legal aid and justice reform interventions
• Before-and-after designs identify change while recognising alternative explanations
• Comparison groups selected using matching, phased rollout or eligibility thresholds
• Contribution analysis tests causal claims through evidence of influencing factors
• Process evaluation examines implementation fidelity, referral quality and service uptake
• Mixed-methods designs combine outcome data, case studies and stakeholder interviews

Participants can interpret justice measurement findings and communicate defensible conclusions.

• Descriptive analysis calculates rates, proportions, medians and disaggregated comparisons
• Cross-tabulations reveal differences in service use, delay and outcome patterns
• Trend analysis separates seasonal variation from sustained performance change
• Qualitative coding identifies recurring barriers, experiences and unintended effects
• Triangulation compares survey, administrative and interview evidence before conclusions
• Data visualisation presents justice outcomes without obscuring small subgroup counts
• Findings framed with limitations, uncertainty and appropriate claims of contribution

Participants can establish governance arrangements and an implementation plan for a justice measurement system.

• Measurement governance assigns ownership, approval rights and escalation responsibilities
• Data-sharing agreements define purpose, confidentiality, security and permitted use
• Indicator review cycles retire weak measures and update operational definitions
• Learning agendas connect evidence gaps with management and policy decisions
• Evaluation terms of reference specify scope, methods, deliverables and ethical safeguards
• Implementation roadmaps sequence baseline work, system changes and reporting milestones
• Application plans prioritise immediate improvements within available staff and budgets