Research Note
Decision Review Protocol
A decision review should freeze the evidence available at decision time before discussing the result. Record the decision statement, owner, deadline, alternatives, eviden
In this article
Decision Review Protocol
A decision review should freeze the evidence available at decision time before discussing the result. Record the decision statement, owner, deadline, alternatives, evidence, uncertainties, probabilities, assumptions, constraints, affected people, authority, foreseeable harms, controls, stop rules, and dissent.
The reviewer then evaluates process quality without the outcome. Did the team define the problem correctly, seek relevant evidence, compare realistic alternatives, identify uncertainty, assign authority, and plan recovery?
Only after that review should the outcome be opened. Compare the result with the predicted range, inspect surprises, distinguish luck from a process defect, and update future rules.
The protocol is not a way to defend a preferred decision. It requires evidence that existed before the outcome and makes missing documentation count against confidence.
Sources
Follow the evidence.
- Brier probability-forecast verification paperjournals.ametsoc.org
- Prospective hindsight studyonlinelibrary.wiley.com
- Spotify episodeopen.spotify.com
- Outcome-bias replication and extensionspmc.ncbi.nlm.nih.gov
- Outcome bias in decision evaluationpubmed.ncbi.nlm.nih.gov
- NFL account of the Malcolm Butler interceptionnfl.com
- Thinking in Bets publisher recordpenguinrandomhouse.com
- WSOP report on the 2010 heads-up championshipwsop.com
- WSOP Tournament of Champions historywsop.com
- WSOP official media guidewsop.com