cold-chain · deliverable

Evaluation Plan — Kirkpatrick-style measurement design

Intervention: Cold-Chain Check receiver certification program (module + animated explainer + job aids + coaching moments)

Objective linked (agreed at action-mapping): post-acceptance discovery of temperature abuse ↓ ≥60% within 90 days; unnecessary rejections < 10% of all rejections; 100% of receivers certified at ≥85% first attempt.

Level 1 — Reaction (was it worth their dock time?)

Instrument	When	Metric	Target
3-question in-module poll (usefulness, clarity, confidence)	On module completion	% rating "useful/very useful"	≥80%
Team lead pulse check after toolbox talk + explainer	Week 1 rollout	Qualitative themes collected	Documented

Cost: zero. Built into the module's final screen.

Level 2 — Learning (can they make the right calls?)

Instrument	When	Metric	Target
Scenario certification quiz (7 decision items randomized from an 8-item bank — borderline calls, not recall trivia)	End of module	First-attempt score	≥85% pass; item-level report per gate for weak spots
Practical sign-off observation (new hires)	During supervised shifts	Four-gate routine completed by mentor	100% of new receivers within 4 weeks

Level 3 — Behavior (do routines show up at goods-in?)

Instrument	When	Metric	Target
Mentor observation card: core-probe before signature on chilled loads (5 spot checks/receiver)	Weeks 2–8	% of observed acceptances with full routine executed	≥90%
Rejection-note coding for protocol decision vs. defensive guess	Continuous	Trend split	Defensive-guess share shrinking toward <10% of rejections
Chill-dock timer compliance: loads returned to chill during escalations	Continuous	% of escalated loads parked in chill within 30 min	≥95%

Level 4 — Results (did the numbers the map promised move?)

Instrument	When	Metric	Target
Quality records: post-acceptance temperature-abuse discoveries	Day 0 baseline → day 90	Problem pallets per quarter	23 → ≤9 (↓ ≥60%)
Rejection audit: unnecessary rejections (good loads rejected without protocol basis)	Day 0 → day 90	Share of all rejections	< 10% (from 31%)
Re-certification currency	Day 90	% active receivers certified	100%

Reporting cadence

Week 2: L1/L2 snapshot to operations manager (one page).
Day 45: interim rejection-trend + behavior-spot-check readout.
Day 90: full four-level report with go/no-go recommendation on extending the format to frozen and ambient receiving.

Data ethics note

Observation data is used for program improvement only, not individual discipline; reported aggregated. Consistent with works council (OR) expectations and AVG/GDPR principles of purpose limitation.

Attribution honesty

Rejections and dock delays have seasonal drivers (summer heat, volume peaks). The day-90 readout separates program effect from seasonality using the prior-year same-quarter baseline; where attribution is ambiguous, the report says so rather than claiming the win.

(This plan doubles as evidence of measurement thinking across target roles — Exact, FareHarbor, UMC, DSV, Ricoh all demand it. The L4 targets above are the same numbers promised in the action map and needs analysis — one chain of custody from goal to measurement.)

Prefer the source? Download the raw markdown.