Practical Drift — Orange Pill Wiki
CONCEPT

Practical Drift

Scott Snook's extension of Vaughan's framework — the gradual divergence between how work is supposed to be done and how work is actually done under the pressures of daily practice, producing a gap between doctrine and reality that no single decision creates and no single correction reverses.

Practical drift names the structural phenomenon in which formal standards and practical standards diverge through the accumulated weight of competent adaptations. Snook formalized the concept in his 2000 study of the 1994 Black Hawk friendly-fire incident, demonstrating that the gap between doctrine and practice is not produced by disobedience but by the ordinary operation of institutional life — by practitioners solving the problems in front of them, reconciling formal requirements with operational realities through countless small accommodations. In AI-augmented knowledge work, practical drift operates with particular severity because many formal standards are implicit rather than codified, making the drift doubly invisible.

In the AI Story

Hedcut illustration for Practical Drift
Practical Drift

Snook's contribution, built directly on Vaughan's framework, was to demonstrate that practical drift is structural rather than behavioral — that it emerges from the mismatch between static formal standards and dynamic operational environments. The formal standard is designed for a world that holds still; the practical standard evolves in a world that does not. The two diverge because the world changes faster than the protocols governing it.

Applied to AI-augmented knowledge work, practical drift takes on characteristics neither Vaughan nor Snook encountered in their original studies. Many formal standards in knowledge work — that an engineer understand what she deploys, that an attorney read the cases she cites, that a physician reason independently toward a diagnosis — exist as professional norms rather than codified regulations. When these implicit standards drift, there is no document to compare against, no specification to point to.

The concept produces Snook's most consequential insight: practical incompetence produced by practical competence. The adaptations that make daily work function smoothly are the same adaptations that, under stress conditions, leave the organization unable to perform the functions its formal standards were designed to ensure. The practitioners are competent; the work is excellent by the standards the practice has established; the standards the practice has established are narrower than the standards the profession was built on.

Across legal practice, medical diagnosis, financial analysis, and software engineering, the AI-driven practical drift follows the same pattern. The formal standard — read the cases, understand the code, reason independently — is replaced by a practical standard — check the citations, verify the tests, confirm the AI's assessment — that is adequate for normal operating conditions and inadequate for the conditions that exceed the normal range.

Origin

Snook developed the concept in Friendly Fire (Princeton University Press, 2000), his study of the April 1994 incident in which two U.S. Army Black Hawk helicopters were shot down by American F-15 fighters over northern Iraq, killing twenty-six people. The investigation revealed that the failure was produced not by any identifiable violation but by the accumulated divergence between doctrine and practice across multiple organizations.

Key Ideas

Adaptation, not disobedience. Practical drift emerges from competent adaptation to operational reality, not from failure to follow rules.

Implicit standards drift invisibly. Knowledge work's formal standards often exist as professional norms rather than written policy, making drift impossible to measure formally.

Inherited practical standards. New entrants learn the practiced standards rather than the specified ones, treating the drifted baseline as the only baseline.

Adequate for normal conditions. The practical standard is adequate for the conditions the practitioners have experienced; the formal standard was designed for the conditions they have not.

Paradox of practical competence. The adaptations that make daily work function are the same adaptations that fail under stress.

Appears in the Orange Pill Cycle

Further reading

  1. Scott A. Snook, Friendly Fire: The Accidental Shootdown of U.S. Black Hawks over Northern Iraq (Princeton University Press, 2000)
  2. Diane Vaughan, The Challenger Launch Decision (1996)
  3. Karl Weick, "The Collapse of Sensemaking in Organizations: The Mann Gulch Disaster" (1993)
Part of The Orange Pill Wiki · A reference companion to the Orange Pill Cycle.
0%
CONCEPT