Training Evaluation and Impact Measurement Course

Participants can select an evaluation model appropriate to programme risk and purpose.

• Kirkpatrick’s Four Levels: reaction, learning, behaviour and results measures
• LTEM levels applied to attendance, knowledge, proficiency, transfer and impact
• Kaufman’s five levels including societal and organisational consequence measures
• Phillips ROI Methodology positioned within a staged evaluation architecture
• ISO 10015 guidance for monitoring training quality and effectiveness
• Model selection criteria: stakes, maturity, cost, evidence needs and timescale

Participants can map how training activities are expected to produce results.

• Logic models linking inputs, activities, outputs, outcomes and intended impacts
• Results chains connecting capability changes to operational performance measures
• Assumptions and external factors documented beside each causal link
• Theory of change statements tested against programme design evidence
• Contribution pathways mapped for manager support, systems and workplace conditions
• Outcome maps distinguishing direct training effects from wider change initiatives

Participants can write measurable objectives and evaluation success criteria.

• Bloom’s taxonomy used to specify knowledge, skill and judgement outcomes
• SMART performance objectives written with conditions, standards and timeframes
• Terminal and enabling objectives separated within complex learning programmes
• Success criteria translated into observable behaviours and performance thresholds
• Baseline measures established before programme launch or cohort enrolment
• Alignment checks between needs analysis, objectives, content and evaluation measures

Participants can convert stakeholder needs into a structured measurement framework.

• Evaluation questions framed around relevance, effectiveness, transfer and value
• Indicator definitions specifying numerator, denominator, source, frequency and owner
• Measurement matrices linking questions, indicators, methods, timing and responsibilities
• Leading indicators identified before lagging operational and financial results appear
• Disaggregation plans for role, location, cohort, manager and demographic groups
• Data dictionaries documenting metric definitions, calculations and interpretation rules

Participants can measure participant experience and learning gain with fit-for-purpose methods.

• Level One surveys focused on relevance, confidence, usability and support
• Likert scales designed with balanced anchors and unambiguous response options
• Pre-test and post-test designs measuring knowledge and skill gains
• Criterion-referenced assessments aligned with stated learning objectives and standards
• Confidence ratings separated from demonstrated competence and assessed performance
• Response-rate monitoring and non-response bias checks for participant feedback

Participants can assess whether learning is applied consistently at work.

• Transfer measures based on frequency, quality, consistency and task complexity
• Manager follow-up surveys assessing opportunity, reinforcement and observed behaviour
• Behavioural observation checklists built from critical work tasks and standards
• Transfer climate assessed through supervisor support, peer norms and resources
• Thirty, sixty and ninety-day follow-up schedules matched to application cycles
• Barriers to transfer classified as learner, manager, system or process factors

Participants can connect training outcomes to meaningful operational performance measures.

• Operational KPIs selected for quality, productivity, risk, service and retention
• Balanced Scorecard perspectives used to locate relevant programme outcome measures
• Customer, employee and process indicators linked to targeted trained behaviours
• Target values established using historical performance, standards or comparator groups
• Time-lag assumptions documented between learning transfer and business result changes
• Performance data limitations assessed before attributing results to training

Participants can create reliable data-collection instruments for an evaluation plan.

• Question wording avoids double-barrelled, leading and socially desirable responses
• Rating scales matched to construct definitions and intended analytical use
• Open questions designed to elicit actionable evidence rather than general comments
• Interview protocols structured around evaluation questions, probes and recording procedures
• Pilot testing identifies ambiguity, completion burden and missing response categories
• Instrument version control preserves comparability across cohorts and reporting periods

Participants can collect and interpret qualitative evidence of programme experience and transfer.

• Semi-structured interviews capture participant, manager and sponsor perspectives systematically
• Focus group protocols manage dominance, confidentiality and divergent viewpoints
• Critical incident technique identifies behaviours, conditions and consequential outcomes
• Thematic coding converts narrative evidence into traceable findings and patterns
• Codebooks define categories, inclusion rules, exclusions and illustrative quotations
• Triangulation compares interview, observation, survey and operational data sources

Participants can plan proportionate, ethical and defensible evaluation data collection.

• Census and sample approaches selected according to population size and risk
• Random, stratified and purposive sampling matched to evaluation questions
• Sample-size considerations balanced against precision, resources and response expectations
• Informed consent statements explain purpose, confidentiality, use and voluntary participation
• Personal data minimisation applied to evaluation records and reporting outputs
• Data retention schedules assign access rights, storage controls and disposal rules

Participants can analyse evaluation datasets and explain findings accurately.

• Data cleaning checks duplicates, missing values, outliers and inconsistent codes
• Frequency tables summarise completion, response, pass and transfer measures
• Means, medians and distributions interpreted for rating and assessment results
• Cross-tabulations compare outcomes by cohort, role, location and manager
• Pre-post score changes calculated using absolute and percentage-point differences
• Charts selected for trend, comparison, distribution and relationship reporting

Participants can make proportionate claims about training contribution to results.

• Correlation distinguished from causation when interpreting programme outcome data
• Comparison groups designed using similar roles, sites or untrained cohorts
• Control group limitations considered where withholding training creates operational risks
• Contribution analysis tests alternative explanations using evidence and stakeholder validation
• Trend analysis separates programme timing from pre-existing performance movement
• Confidence statements calibrated to evidence quality, assumptions and data limitations

Participants can calculate training costs, monetised benefits and return on investment.

• Fully loaded training costs include design, delivery, materials, travel and participant time
• Benefit categories distinguish cost avoidance, revenue, productivity and quality improvements
• Monetisation methods convert time saved, defects reduced and turnover avoided
• Isolation techniques estimate training contribution using controls, trends and expert estimates
• Phillips ROI formula calculates net benefits divided by programme costs
• Sensitivity analysis tests assumptions behind benefit estimates and financial claims

Participants can communicate evaluation evidence to operational and executive audiences.

• Audience analysis determines report depth, language, frequency and recommended actions
• Evaluation dashboards combine participation, learning, transfer and outcome indicators
• Data visualisation choices prevent misleading scales, clutter and unsupported comparisons
• Executive summaries state findings, limitations, implications and decisions required
• Technical appendices document methods, samples, calculations and evidence sources
• Recommendation logs assign owners, deadlines, measures and follow-up review dates

Participants can establish repeatable evaluation processes that inform programme improvement.

• Plan-Do-Study-Act cycles convert evaluation findings into programme design changes
• Evaluation calendars coordinate baseline, delivery, follow-up and reporting milestones
• RACI matrices clarify accountability for data collection, analysis and action
• Vendor scorecards specify evidence requirements for externally delivered training programmes
• Quality assurance reviews test instrument consistency, evidence traceability and reporting accuracy
• Evaluation maturity assessments identify priorities for process, capability and technology investment

Participants can build, review and present a complete evaluation plan for a workplace training programme.

• Programme logic model completed from business need through intended operational outcomes
• Evaluation questions prioritised against stakeholder decisions, risks and available resources
• Measurement matrix specifies indicators, instruments, sampling, timing and accountable owners
• Transfer and business-result measures linked to credible evidence sources
• Cost-benefit assumptions documented with isolation methods and sensitivity ranges
• Dashboard, report outline and executive recommendations prepared for sponsor review