Distance from Consequences

In the AI Story

Distance operates in multiple registers. Physical distance — the bomber at twenty thousand feet — is the most visible. But conceptual distance may matter more. The bureaucrat who converts persons into numbers on a form has not moved physically, but has imposed a conceptual barrier that prevents the numbers from functioning as reminders of persons. Linguistic distance — special treatment, enhanced interrogation, collateral damage, users, engagement — performs the same work through vocabulary.

Organizational distance is built into the architecture of modern institutions. The designer of a recommendation algorithm does not meet the teenager it captures. The engineer who implements the engagement loop does not see the parent whose child has become unreachable. The distance is not a failure of the system. It is a feature of scale: mass production requires the separation of production from consumption, and the separation creates the conditions under which the human response cannot fire.

The new species introduced by AI is more subtle. Before AI, a developer writing code by hand traversed the implementation space. Each decision — the timing of the notification, the calibration of the variable reward schedule, the wording of the alert — was an encounter with the specific future of the system's effect on a specific future person. The person remained abstract, but the effect was concrete. Implementation was a moral geography, and the geography contained moments where the human response might surface.

Claude Code removes the traversal. The developer describes the desired behavior; the tool produces the implementation. The developer reviews the output at the level of specification, not implementation. The moral geography has been bypassed. The encounters that might have triggered the flicker of discomfort — the third hour of coding the timing algorithm, the late-night realization of what the system will actually do — do not occur because the third hour has been compressed to a prompt.

Glover's framework is careful to distinguish this from moral weakness. The builder using AI to bypass implementation is not choosing to ignore the downstream. She is operating under conditions where the downstream is not available to her in the same way. The conditions are structural, and the response must be structural: deliberate construction of the proximity that friction once provided incidentally.

Origin

The observation that distance suppresses moral response is ancient — Aristotle noted it; the Greek dramatists turned it into plot. Its systematic study in modern moral psychology traces through Stanley Milgram's obedience experiments (where the physical distance of the "learner" from the "teacher" dramatically altered compliance rates) and through Dave Grossman's research on combat distance and killing.

Glover's contribution was to integrate these scattered findings into a unified account of how institutions produce harm through structural distance, and to insist that the distance is not incidental but functional — that institutions which produce harm at scale are, in effect, designed to create the distances that make the harm psychologically possible for ordinary agents. The design is rarely intentional in the sense of malicious planning; it is intentional in the architectural sense that efficient production at scale requires the separations that suppress moral response.

Key Ideas

Multi-dimensional. Distance is not only physical. It is conceptual, linguistic, organizational, temporal, and — now — functional.

Scale-correlated. Larger operations require greater distances. This is why the mechanisms of mass production and the mechanisms of mass harm share structural features.

Suppresses the involuntary. Distance does not just weaken resolve to act morally; it prevents the firing of the pre-deliberative response that is the operational foundation of most moral behavior.

AI introduces functional distance. The elimination of implementation journey is a new dimension: the builder no longer inhabits the moral geography where encounters might occur.

Constructible proximity. The remedy is deliberate construction of what friction once provided incidentally — user observation, direct encounter, structural refusal to let the tool mediate every relationship with the downstream.