The Fidelity Check

In the AI Story

The operation depends on the distinction Scarry develops between the imagined and the perceived. The builder's imagination of the product is thin — it possesses only the properties the imagination actively constructed. The generated artifact is dense — it possesses material properties the imagination did not anticipate. The fidelity check is the labor of thickening the builder's understanding to match the artifact's density, through sustained examination from angles the imagination did not construct.

In conventional making, this thickening occurred automatically as a byproduct of material engagement. The craftsman negotiating with wood encountered the wood's resistance and was educated by it. The programmer writing code encountered the code's syntax, execution patterns, and failure modes, and was educated by them. In AI-mediated making, the material engagement is attenuated — the tool handles the negotiation — and the education does not occur as a byproduct. It must be actively pursued through the fidelity check.

The operation is demanding. It requires the capacity to hold the intention in active memory while examining the generated output against it. It requires sustained attention of the specific quality that beauty teaches: lateral precision, attention to the specific rather than the approximate, the willingness to examine the object on its own terms rather than accepting the surface impression. It requires the capacity to distinguish between divergences that represent legitimate excess (properties the artifact possesses that the imagination did not anticipate but that serve the builder's intention) and divergences that represent deficiency or fabrication (properties the artifact claims to possess but that do not hold up under examination).

The failure to perform the fidelity check has specific consequences that Segal identifies in The Orange Pill: the engineer who makes architectural decisions with less confidence than she used to and cannot explain why. Her imagination of the system remains thin. The system itself is dense. The gap between her thin understanding and the system's dense reality has not been bridged by the labor of fidelity checking, and her judgment has eroded accordingly. Scarry's framework names what has happened: the builder has not performed the work that only a consciousness with intention can perform, and her capacity to evaluate the artifact has atrophied as a result.

Origin

The concept is a contemporary application of Scarry's framework rather than a term she herself uses. It draws directly on the analysis of imagination and perception in Dreaming by the Book and the account of fair surfaces in On Beauty and Being Just.

Key Ideas

Comparison of imagined and real. The operation requires holding the imagined intention and the generated artifact in simultaneous view, with the precision needed to detect their points of divergence.

Not automatable. Only a consciousness that imagined the product can compare the product to the imagination; the tool that generated the artifact cannot perform this comparison.

Aesthetic in Scarry's sense. The check is a judgment about the quality of the match — does the artifact achieve the specific correspondence the intention reached for?

Walking around the object. The operation requires examining the artifact from angles the imagination did not construct, discovering its material density, encountering the properties imagination cannot contain.

Bridges the thinness gap. The practice thickens the builder's understanding to match the artifact's density, restoring the education that material engagement historically provided automatically.

Debates & Critiques

Some practitioners argue that emerging AI tools — particularly those equipped with better interpretability and verification capabilities — can progressively automate more of the fidelity check, leaving humans to perform only the highest-level judgments. Scarry's framework would reply that the essential operation depends on a consciousness with intention, and that intention cannot be delegated to the tool that generates the artifact. Improved tools may support the fidelity check (by surfacing discrepancies, by generating multiple candidates for comparison, by automating specific verification subtasks), but they cannot perform the operation itself, because the operation is the comparison with the builder's interior experience.