12. Recalibration — Running the Audit Yourself

The procedure

1. Name the claim exactly, not the vibe around it.
2. Name who holds it — the person, company, or professional culture with a stake in it being believed.
3. Ask what was measured, by whom, and over what period.
4. Ask who would have had to pay, film, or publicise the alternative to make it visible.
5. Rule: state which side the measurement supports, and how confidently, in one sentence.

Where this audit is weakest

Chapter 6's evidence is entirely American — Dale and Krueger's 2002 college data and Chetty, Friedman and Rockoff's 2014 teacher study both draw on US datasets. Chapter 2's Blue Zones critique is itself contested: Newman's 2024 preprint has not cleared peer review, and Blue Zones' own demographers reject it point by point. Chapter 11's checklist verdict rests on the 2006 Michigan result, but Urbach's 2014 Ontario trial found no significant change despite over 90% compliance. This book is written in English, by one team, from one vantage point — the same visibility problem it audits in everyone else.

What survives

Every verdict in this book could be wrong, revised, or contested — several already are, inside their own chapters. What survives is not any single ruling but the procedure: name the claim, name who holds it, ask what was measured, ask who would have had to pay to make it visible, then rule. That procedure produced the Blue Zones doubt, the checklist's Ontario caveat, and this chapter's own admission. A reader who runs the same steps on a claim this book never touched gets the same protection this book tried to give itself.

Example: Run the procedure on this book's own Blue Zones claim — name Dan Buettner, weigh Newman's birth records against Blue Zones' civil and church registries, ask who would have had to pay to correct the story — and it returns the same contested verdict as Chapter 2, not a cleaner one.

Verdict. The audit is a procedure, not a conclusion, and it survives every individual chapter it produced.

Overturned if: a claim run through all five steps still returns a confident ruling that the next measurement flatly reverses — as happened once already, in Chapter 11's move from Michigan to Ontario.

Sources. 2024 · Saul Justin Newman, "Supercentenarian and remarkable age records exhibit patterns indicative of clerical errors and pension fraud" — bioRxiv · 2014 · David Urbach et al., "Introduction of Surgical Safety Checklists in Ontario, Canada," NEJM — NEJM