Moral Friction

In The You On AI Encyclopedia

Moral friction must be distinguished from other kinds of friction. Mechanical friction is the tedium of repetitive tasks, the overhead of translation between intention and execution. Its removal is genuinely liberating. Cognitive friction is the difficulty of thinking hard. Its removal is sometimes liberating, sometimes harmful, depending on what the thinking was for. Moral friction is specifically the resistance that marks a values conflict. Its removal is never neutral — it always suppresses a function that serves moral formation.

The conflation of these kinds of friction is the central intellectual error of the smoothness aesthetic Han diagnosed and Segal developed in You On AI. When all friction is treated as cost and all smoothness as gain, moral friction gets smoothed away with the mechanical and the cognitive. The builder who once felt tightness before shipping an engagement loop now ships without the tightness, not because her values have changed but because the mechanism that would have registered the tightness — the hours of implementation during which the system's specific effects became concrete — has been eliminated.

Preservation of moral friction requires structural work. It cannot be left to individual virtue, because individual virtue is precisely what erodes when the structural conditions that exercise it are removed. Glover's prescription, consistent across his work, was institutional: build structures that force the friction to surface even when individual convenience would prefer to avoid it. Mandatory reviews. Stop-the-line authority. Institutional slowdowns at specific junctures. These are not inefficiencies. They are the institutional equivalent of muscle — the resistance that prevents the smooth efficiency of production from eliminating the discomfort on which moral selfhood depends.

The concept connects directly to ascending friction from You On AI, but adds a moral dimension Segal's framework did not emphasize. Ascending friction describes how AI relocates difficulty from lower to higher cognitive floors. Moral friction asks whether the new friction at the higher floor includes the specifically moral resistance that the old friction at the lower floor produced as a byproduct. The answer, in many current AI workflows, is no: the ascended friction is judgment friction without being moral friction, and the difference matters for what kind of self the new workflow builds.

Origin

The concept is implicit in much of Glover's work but receives its fullest articulation as applied to contemporary conditions in the On AI simulation. Related concepts appear across moral philosophy — Christine Korsgaard's account of the friction of practical reason, Bernard Williams's one thought too many and the resistance it marks, Iris Murdoch's account of the difficulty of seeing the moral reality of another. All point toward the same observation: moral life involves resistance, and the resistance is not incidental but constitutive.

The specific application to AI-assisted workflows draws on empirical observations from Diane Vaughan's work on normalization of deviance, the Berkeley study of AI-intensified work, and the growing literature on moral deskilling in automated environments. The through-line is the suspicion that the absence of felt resistance — the smoothness of the workflow — correlates with the erosion of the moral formation the resistance would otherwise have supported.

Key Ideas

A psychological event, not a principle. Moral friction is an actual felt resistance, not an abstract consideration.

Distinguishable from other friction. It is not the same as mechanical or cognitive friction and should not be eliminated when those are eliminated.

Signals values conflict. Its firing means something is wrong from the standpoint of one's current values. Its not-firing does not mean nothing is wrong — it may mean the mechanism has atrophied.

Strengthened by honoring, weakened by overriding. The friction is a muscle. Its use builds it; its disuse atrophies it.

Preserved by structure, not by virtue. Individual virtue cannot maintain friction against a structural environment designed to eliminate it. Institutional architecture is required — and the architecture must be built deliberately, against the efficiency gradient.