You On AI Field Guide · The Vocation of the Builder The You On AI Field Guide Home
Txt Low Med High
CONCEPT

The Vocation of the Builder

The Weberian-Jonasian claim that <em>building powerful tools is a calling with built-in moral obligations</em> — responsibilities constitutive of the activity itself, not added to it from outside.
Max Weber's 1919 Munich lecture 'Science as a Vocation' argued that the person who devotes a life to intellectual or creative work takes on obligations that extend beyond the work itself — obligations constitutive of the vocation, not added to it. The scholar does not first become a scholar and then acquire ethical obligations. The obligations are built into the act of scholarship. To understand something deeply is to become responsible for that understanding, including its uses and consequences. Jonas absorbed Weber's conception and extended it into the technological domain. The builder of powerful tools — the engineer, the designer, the entrepreneur, the researcher — possesses a vocation in Weber's sense: a calling that carries built-in moral obligations internal to the activity itself. To build something powerful is to become responsible for that power, including the uses to which others will put it, the consequences that will unfold in domains the builder never intended to affect, and the long-term effects on conditions the builder may not live to see.

In The You On AI Field Guide

The conception cuts against the grain of a technological culture that has systematically separated building from responsibility. The separation operates through institutional mechanisms so embedded in the culture of innovation that they are rarely examined. The most common is the division of labor between creation and deployment: the AI researcher builds the model, the product team deploys it, the compliance department evaluates risks, the legal team manages liabilities. Each actor occupies a role whose boundaries define the scope of its responsibility. The cumulative effect is that no single actor bears responsibility for the whole.

Jonas would identify this as a structural evasion — not a conspiracy but a systemic property of organizations specialized enough to distribute functions across bounded roles. The child whose cognitive development is reshaped by the tool that all these actors collectively brought into the world falls between the gaps. No single actor's bounded responsibility encompasses the child. Segal's concept of the priesthood in You On AI makes a parallel argument: those who understand systems from the inside bear specific responsibility because their understanding gives them specific capacity to anticipate consequences others cannot see.

The builder's obligation operates at three levels of increasing moral difficulty. The first level is responsibility for intended consequences — outcomes the builder designed the system to produce. The second level is responsibility for foreseeable misuse — outcomes the builder did not intend but could have anticipated. The third level, hardest and most distinctive, is responsibility for consequences that cannot be foreseen — the obligation to acknowledge that one is acting in a domain where consequences exceed the capacity for prediction, and to act accordingly.

At the third level, the obligation is not to foresee the unforeseeable but to build for the possibility of correction, create systems including mechanisms for monitoring and adjusting, and resist structural pressure to deploy at speed and scale that makes correction impossible. The builder who deploys a powerful system knowing its long-term consequences are unpredictable and that its deployment cannot be easily reversed has taken a gamble with consequences borne by others. The asymmetry of the wager applies: the builder captures the benefits while users, children, future persons bear the risk.

Origin

Jonas developed the concept explicitly in The Imperative of Responsibility and the essays collected in Philosophical Essays: From Ancient Creed to Technological Man. The Weberian lineage was deliberate; Jonas studied Weber closely and saw his own work as extending Weber's account of vocation into domains Weber had not anticipated.

Segal's confession in You On AI about having built addictive products earlier in his career illustrates the three-level structure: the harm became visible retrospectively, and Jonas would use the confession not as condemnation but as evidence that the capacity for moral recognition exists, and the question is whether it can be moved forward in time — from regret to anticipation.

Key Ideas

Responsibility as constitutive. The builder does not acquire responsibility as an external addition to the building; the responsibility is internal to the activity, built into what it means to build powerfully.

Three levels of obligation. Intended consequences (easiest), foreseeable misuse (harder, requiring imagination), unforeseeable consequences (hardest, requiring humility and design for correction).

The division-of-labor evasion. Specialized organizational roles distribute responsibility such that no single actor bears the whole — a structural property that builders, not merely institutions, must work against.

Anthropic as institutional example. The company building Claude was founded on premises that Jonas would recognize as acknowledgment of the vocation's three-level structure, though whether the acknowledgment translates into adequate practice under competitive pressure remains open.

Explore more
Browse the full You On AI Field Guide — over 8,500 entries
← Home 0%
CONCEPT Book →