The Review Deficit

In The You On AI Encyclopedia

The deficit follows the four-phase mechanism of normalized deviance. An anomaly — the first errors found in AI-generated code — triggers careful review. Assessment of the track record — low error rate, errors caught downstream — supports reduced review depth. Normalization proceeds: senior engineers develop triaged review practices focused on high-risk sections. Baseline shift occurs as new team members inherit the triaged practice as the only standard they have experienced.

The deficit interacts with production pressure structurally. The mismatch between AI production speed and review speed creates constant incentive to reduce review depth, because the alternative — reviewing at the original standard while the tool generates at the new speed — makes review the bottleneck, and bottlenecks attract institutional pressure to resolve themselves. The resolution is almost always reduction in review depth.

Documented signatures include: declining time-per-review across months of AI tool adoption, shrinking proportion of generated code that receives human inspection, increasing reliance on automated test suites as proxies for comprehensive review, and new-hire onboarding that transmits the practiced review standard rather than the formal one.

The deficit compounds with the comprehension gap and the opacity barrier. Reduced review makes surface-level anomalies harder to catch; opacity makes reasoning-level anomalies invisible even to thorough review; the comprehension gap means many reviewers lack the expertise to evaluate output substantively even when they look carefully. The three limitations together produce a system in which human oversight functions nominally but not substantively.

Origin

Diane Vaughan

The concept combines Vaughan's normalization of deviance with contemporary empirical observation of AI adoption in software engineering organizations, drawing on the Berkeley ethnographic studies of AI-augmented workflows and cybersecurity research into deployment practices.

Key Ideas

Four-phase erosion. Review depth follows the classic normalization sequence from careful attention to formality.

Rational at each step. Each reduction is supported by the tool's track record and the allocation of finite cognitive resources.

Structural incentive. The speed mismatch between generation and review creates constant pressure to reduce review depth.

Multiplicative with opacity. The deficit weakens surface-level detection while opacity prevents reasoning-level detection, producing compound vulnerability.

Generational transmission. New team members inherit the practiced standard as the only standard, and the drift becomes invisible to the organization.