Rules: A Short History of What We Live By — Orange Pill Wiki
WORK

Rules: A Short History of What We Live By

Daston's 2022 Princeton landmark tracing the history of rules from ancient Greek recipes through medieval monastic codes to contemporary machine-learning systems — the book that developed the thick/thin rule distinction applied throughout her AI analysis.

Rules: A Short History of What We Live By (Princeton, 2022) is Daston's sweeping account of how rules have been conceived, codified, and applied across three millennia of human civilization. The book's argument is that what appears to be a single category — rules — actually contains radically different types of normative guidance, and that the history of rules is the history of tension between two poles: thick rules accompanied by extensive contextual judgment, and thin rules designed for mechanical execution without discretion. The book traces how thick rules repeatedly thin under pressures of scale, efficiency, and accountability — and how, equally repeatedly, thick judgment must be reintroduced to handle the cases thin rules cannot accommodate.

In the AI Story

Hedcut illustration for Rules: A Short History of What We Live By
Rules: A Short History of What We Live By

The book's range is extraordinary. It begins with ancient Greek recipes — technai that bundled procedures with explicit guidance on exceptions, materials, and circumstances. It traces the evolution through Roman legal codes, medieval monastic rules (Benedict's rules for monastic life explicitly include commentary on when and how to deviate from them), Enlightenment attempts to codify legal judgment into algorithmic decision procedures, nineteenth-century bureaucratic rules, and twentieth-century attempts to replace human judgment with algorithmic systems.

Across this range, Daston identifies a recurrent pattern. Thin rules are repeatedly proposed as solutions to problems of scale, consistency, and accountability. They work — partially, and within specified conditions. When conditions vary, they fail. When they fail, human judgment is reintroduced to handle the cases the thin rules could not anticipate. The thick judgment does not replace the thin rule; it supplements it, cleaning up after its characteristic failures. The cycle then repeats, with new proposals for thinner rules that will finally eliminate the need for judgment — and the same outcome.

The book is particularly sharp on the historical relationship between rules and exceptions. Thin rules imagine a world in which exceptions are aberrations — deviations from a norm that could, in principle, be specified more precisely. Thick rules imagine a world in which exceptions are the norm — cases that the rule must handle through the exercise of judgment the rule itself acknowledges is necessary. The history of rules, Daston argues, repeatedly confirms the thick-rule view: the exceptional cases are not marginal phenomena but the substantial bulk of real situations.

The relevance to AI is explicit in the book's concluding chapters. Machine-learning systems implement thin rules at an unprecedented scale — statistical inferences that operate without contextual judgment, without discretion, without awareness of the cases they cannot accommodate. The book's historical argument is that such systems cannot operate reliably without the thick judgment of humans who handle the cases the thin rules fail to predict. The institutional question is whether we are constructing the infrastructure for that thick judgment — and the book's pessimistic answer, developed more fully in the AI volume, is that we are not.

Origin

The book emerged from Daston's decades of research on the history of scientific method, algorithmic thinking, and the relationship between rule-following and judgment. It synthesizes arguments made in earlier works including Classical Probability in the Enlightenment and Objectivity, extending them into a comprehensive historical analysis of rules as a category.

The book was widely reviewed and became an unexpected crossover success, read not only by historians of science but by legal scholars, philosophers, technologists, and policy analysts concerned with the operation of rules in algorithmic systems. It has become a key reference text in discussions of AI governance, machine-learning ethics, and the future of rule-based systems.

Key Ideas

Three millennia of rule-making. The book traces rules from ancient Greek recipes through contemporary algorithms, identifying consistent patterns across radically different domains.

Thick and thin as analytical poles. Individual rules vary in their thickness; the distinction is not binary but identifies two poles of a spectrum that shapes how rules operate.

The thinning tendency is historical. Pressures toward efficiency, scale, and accountability repeatedly drive rules from thick toward thin — but the thinning is never complete.

Exceptions are the norm. Real cases reliably exceed the specifications of thin rules; the exceptional cases are substantial, not marginal.

AI as the latest thinning project. Machine learning implements extremely thin rules at unprecedented scale, requiring thick human judgment that the institutional environment has not adequately developed.

Debates & Critiques

A debate concerns whether the thick/thin framework adequately captures the specific features of algorithmic systems or whether those systems constitute a genuinely new category that resists the old distinction. Defenders argue that the framework remains useful with adjustments; critics argue that statistical inference from large corpora differs qualitatively from rule-following in the traditional sense. A related debate concerns whether Daston's pessimism about the institutional infrastructure for AI-era thick judgment is warranted or whether emerging developments in AI governance, professional standards, and educational curricula will prove adequate faster than the historical pattern suggests.

Appears in the Orange Pill Cycle

Further reading

  1. Daston, Rules: A Short History of What We Live By (Princeton, 2022)
  2. Michel Foucault, Discipline and Punish (Pantheon, 1977)
  3. James Scott, Seeing Like a State (Yale, 1998)
  4. Cathy O'Neil, Weapons of Math Destruction (Crown, 2016)
Part of The Orange Pill Wiki · A reference companion to the Orange Pill Cycle.
0%
WORK