CONCEPT
Builder Responsibility
The principle — defended by
Wiener at considerable personal cost — that the creators of powerful systems bear moral responsibility for what those systems do after deployment, and that the claim of value-neutral research is a fiction that transfers responsibility to less accountable actors.
Builder responsibility is the ethical position Wiener developed in response to his wartime work on
anti-aircraft fire control and defended for the remaining two decades of his life at substantial professional cost. The position has two claims. First, the builder of a powerful system — particularly one that learns, adapts, or operates autonomously — bears continuing moral responsibility for the system's downstream consequences. The construction does not end the obligation; it begins it. Second, the claim that research is morally neutral, that the engineer's responsibility ends when the specification is met, is a fiction whose function is to transfer responsibility to institutions (governments, corporations, markets) less accountable than the engineer. Wiener rejected this fiction explicitly in a 1947 open letter in the
Atlantic Monthly declining to provide information to military agencies, and he maintained the position consistently through his final book
God & Golem, Inc.