The classic experimental demonstrations are striking. Trivia statements printed in clear fonts are rated as more true than identical statements in harder-to-read fonts. Questions printed in high-contrast type produce higher confidence ratings than identical questions in low-contrast type. The content is constant; only processing ease varies. The fluency produces a feeling of rightness that System 1 treats as evidence of truth.
In human-to-human communication, the fluency heuristic is imperfect but roughly calibrated. A human expert speaks fluently because they have earned the fluency through engagement with the material; a human who is uncertain stumbles, hedges, pauses. System 1 reads these signals automatically and treats smooth delivery as a (noisy) signal of competence. These signals are absent from AI output. Claude does not stumble when it is uncertain, does not hedge in proportion to the thinness of its training data, does not pause when about to produce a claim that would not survive expert scrutiny.
The Deleuze Error is the paradigmatic case. The passage was philosophically wrong and beautifully written. The wrongness and the fluency were independent properties. System 1 evaluated the passage through the fluency heuristic and registered only the fluency. The passage felt true because it read well.
The social reinforcement compounds the individual cognitive event. When a professional presents AI-assisted work, the audience evaluates it through the same heuristic. Positive feedback reinforces the professional's confidence in the AI-assisted process. At the organizational level, the same loop operates: polished output suggests institutional competence, review procedures relax, institutional System 2 equivalents atrophy.
The counterintuitive prescription is that fluency in AI output should function as a warning rather than a reassurance — a cue to heightened scrutiny rather than reduced vigilance. Segal's practice of deleting Claude's polished passages and writing by hand works because handwritten prose is rough, which prevents the fluency heuristic from generating false confidence.
The fluency literature grew from work on the mere exposure effect (Zajonc), perceptual fluency (Reber and Schwarz), and processing ease. Kahneman integrated these findings into the heuristics-and-biases framework and treated fluency as one of the most practically consequential of System 1's shortcuts.
Thinking, Fast and Slow devotes substantial attention to the mechanism and its practical consequences, emphasizing that awareness of the bias does not prevent its operation — the heuristic fires automatically, below conscious threshold.
Ease as proxy for truth. Processing fluency is read by System 1 as evidence of validity.
Evolutionary calibration broken. The correlation between fluency and reliability held in natural environments; AI severs it.
No disfluency signals in AI. The machine does not stumble when uncertain, removing a traditional cue.
Confidence contagion. Individual fluency-based judgments compound into institutional and cultural trust.
Fluency as warning. The counter-practice: treat polished output as a cue to heightened scrutiny.