‹

08. The Blame Reflex — Why 'Human Error' Ends the Inquiry

EN

08. The Blame Reflex — Why 'Human Error' Ends the Inquiry

The First Story and the Stopping Point

When an accident occurs, organizations frequently default to the "first story," which centers on identifying who performed the action that led to the system failure. Sidney Dekker, in his 2014 work "The Field Guide to Understanding 'Human Error'," argues that this focus on the individual effectively terminates the investigation process. By naming a person as the primary cause, the inquiry stops exactly where a deeper technical or procedural investigation should ideally begin for the organization. This reflexive search for a culprit ignores the systemic conditions that influenced the human actor, leaving the underlying boundary vulnerabilities entirely unaddressed for the future. The "second story," by contrast, seeks to understand why the action made sense to the operator at the time, revealing the real causes within the system.

The Distortion of Hindsight

The human tendency to view past events as inevitable is reinforced by the cognitive phenomenon known as hindsight bias, which was famously analyzed by Baruch Fischhoff. In their 1975 experiment involving 172 students at an Israeli university, Fischhoff and Beyth demonstrated that knowing an outcome significantly distorts one's memory of past uncertainty. The students who were told a historical outcome assigned that outcome a substantially higher retrospective probability than the control group that received no such information. This finding shows that the belief that an error "should have been obvious" is a psychological construct rather than a reliable assessment of the prior situation. Because investigators are aware of the outcome, they suffer from this bias, which makes their retrospective judgment of human performance inherently unreliable and prone to error.

The Responsibility Counterargument

This focus on systemic causes is contested by Parker and Davies in their 2020 paper, which critiques the common industry shift toward a "no blame" culture. They argue for a "responsibility culture" in medicine, suggesting that individuals should still be held accountable for errors that are genuinely foreseeable and avoidable. If blamelessness is taken too far, the authors contend that the organization risks letting genuine negligence escape the necessary scrutiny required for professional accountability.

Example: Blaming a pilot for a crash is like blaming the map for a road that was missing a warning sign at a dangerous intersection.

Verdict. Naming an individual as the cause of a complex system failure is a cognitive shortcut that prevents the discovery of systemic safety risks.

Overturned if: A replication of the 1975 Fischhoff and Beyth study fails to show that knowledge of an outcome inflates the perceived probability of its occurrence.

Sources. 2014 · Dekker, S., "The Field Guide to Understanding 'Human Error'" — Routledge · 1975 · Fischhoff, B. & Beyth, R., "I Knew It Would Happen: Remembered Probabilities of Once-Future Things" — ResearchGate

บทถัดไป · 9 / 1209. The Postmortem — Turning an Outage Into an Asset
Size
Page
Font

At The Seams

❦
101. The Seam — Why Failure Concentrates Where Parts Meet202. Units and Assumptions — The Mismatch Nobody Owns303. The Handoff — Where Information Goes to Die404. Protocol Drift — When Two Sides Disagree About the Contract505. Timeouts and Retries — The Cure That Causes the Disease606. The Silent Success — Failure That Reports Everything Is Fine707. Latent Conditions — Accidents That Were Already There808. The Blame Reflex — Why 'Human Error' Ends the Inquiry909. The Postmortem — Turning an Outage Into an Asset1010. Resilience Engineering — Work as Imagined and Work as Done1111. Control, Not Components — Leveson's Reframing1212. Finding Your Own Seams — The Procedure