Moral Friction — Orange Pill Wiki
CONCEPT

Moral Friction

The specific psychological discomfort — the resistance of a value against a proposed action — that signals a conflict between what the agent is doing and what the agent believes, and whose preservation is the operational condition of moral identity.

Moral friction is not a metaphor. It is a specific psychological event: the tightening in the chest before the ship decision, the hesitation before the approval click, the uncomfortable flicker that surfaces when the tool's fluent output does not match one's uncertain conviction. The friction is unpleasant. That is its function. It marks the moments where moral identity is being tested and where the test can be honored or overridden. Honored repeatedly, the friction strengthens the muscles that produced it. Overridden repeatedly, the friction weakens until it stops firing at all. Glover's career was a study of what happens to institutions and individuals when moral friction is systematically suppressed. His framework, applied to the AI moment, identifies a new form of suppression: not the coercion that eliminated friction in totalitarian regimes but the convenience that eliminates it in the smooth workflow of AI-assisted production. The mechanism is different; the consequence — atrophy of the muscle that makes moral selfhood possible — is the same.

In the AI Story

Hedcut illustration for Moral Friction
Moral Friction

Moral friction must be distinguished from other kinds of friction. Mechanical friction is the tedium of repetitive tasks, the overhead of translation between intention and execution. Its removal is genuinely liberating. Cognitive friction is the difficulty of thinking hard. Its removal is sometimes liberating, sometimes harmful, depending on what the thinking was for. Moral friction is specifically the resistance that marks a values conflict. Its removal is never neutral — it always suppresses a function that serves moral formation.

The conflation of these kinds of friction is the central intellectual error of the smoothness aesthetic Han diagnosed and Segal developed in The Orange Pill. When all friction is treated as cost and all smoothness as gain, moral friction gets smoothed away with the mechanical and the cognitive. The builder who once felt tightness before shipping an engagement loop now ships without the tightness, not because her values have changed but because the mechanism that would have registered the tightness — the hours of implementation during which the system's specific effects became concrete — has been eliminated.

Preservation of moral friction requires structural work. It cannot be left to individual virtue, because individual virtue is precisely what erodes when the structural conditions that exercise it are removed. Glover's prescription, consistent across his work, was institutional: build structures that force the friction to surface even when individual convenience would prefer to avoid it. Mandatory reviews. Stop-the-line authority. Institutional slowdowns at specific junctures. These are not inefficiencies. They are the institutional equivalent of muscle — the resistance that prevents the smooth efficiency of production from eliminating the discomfort on which moral selfhood depends.

The concept connects directly to ascending friction from The Orange Pill, but adds a moral dimension Segal's framework did not emphasize. Ascending friction describes how AI relocates difficulty from lower to higher cognitive floors. Moral friction asks whether the new friction at the higher floor includes the specifically moral resistance that the old friction at the lower floor produced as a byproduct. The answer, in many current AI workflows, is no: the ascended friction is judgment friction without being moral friction, and the difference matters for what kind of self the new workflow builds.

Origin

The concept is implicit in much of Glover's work but receives its fullest articulation as applied to contemporary conditions in the On AI simulation. Related concepts appear across moral philosophy — Christine Korsgaard's account of the friction of practical reason, Bernard Williams's one thought too many and the resistance it marks, Iris Murdoch's account of the difficulty of seeing the moral reality of another. All point toward the same observation: moral life involves resistance, and the resistance is not incidental but constitutive.

The specific application to AI-assisted workflows draws on empirical observations from Diane Vaughan's work on normalization of deviance, the Berkeley study of AI-intensified work, and the growing literature on moral deskilling in automated environments. The through-line is the suspicion that the absence of felt resistance — the smoothness of the workflow — correlates with the erosion of the moral formation the resistance would otherwise have supported.

Key Ideas

A psychological event, not a principle. Moral friction is an actual felt resistance, not an abstract consideration.

Distinguishable from other friction. It is not the same as mechanical or cognitive friction and should not be eliminated when those are eliminated.

Signals values conflict. Its firing means something is wrong from the standpoint of one's current values. Its not-firing does not mean nothing is wrong — it may mean the mechanism has atrophied.

Strengthened by honoring, weakened by overriding. The friction is a muscle. Its use builds it; its disuse atrophies it.

Preserved by structure, not by virtue. Individual virtue cannot maintain friction against a structural environment designed to eliminate it. Institutional architecture is required — and the architecture must be built deliberately, against the efficiency gradient.

Appears in the Orange Pill Cycle

Further reading

  1. Jonathan Glover, Humanity: A Moral History of the Twentieth Century (1999)
  2. Iris Murdoch, The Sovereignty of Good (1970)
  3. Bernard Williams, Moral Luck (1981)
  4. Byung-Chul Han, Saving Beauty (2015)
  5. Christine Korsgaard, The Sources of Normativity (1996)
Part of The Orange Pill Wiki · A reference companion to the Orange Pill Cycle.
0%
CONCEPT