Elon Musk vs Norbert Wiener on AI · Ch6. The Human Use of Human Beings ← Ch5 Ch7 →
Txt Low Med High
HOUR TWO — THE WORK AND THE HUMAN USE
Chapter 6

The Human Use of Human Beings

Page 1 · The Human Use of

**EDO SEGAL:** Professor Wiener, you titled your most important book with its own argument — *The Human Use of Human Beings* — and you meant the phrase as a provocation. We speak of the *use* of tools and resources. To speak of the *use* of human beings is to flirt with the language of exploitation, and you did it on purpose. Give the reader the distinction, and then, Elon, I want to put your own company's product line against it, because I think it cuts both ways through everything you build.

**WIENER:** The distinction is between two ways of putting a human being inside a technical system. In the first, the human is a full participant — an agent who understands what the system is doing, exercises judgment, retains responsibility, and is enlarged rather than diminished by the machinery around them. In the second, the human is a part — slotted into a process designed by others, performing a narrow function, stripped of the context and discretion that would make the activity meaningfully theirs. My sharpest line on this I will repeat exactly: when human atoms are knit into an organization in which they are used not in their full right as responsible human beings, but as cogs and levers and rods, it matters little that their raw material is flesh and blood. The horror is not that we build machines out of metal. It is that we build machines out of people and then forget the parts are people. And my whole ethics of technology reduces to one question asked of every system: does it treat the human as an end to be served, or as a component to be optimized?

**EDO SEGAL:** Elon, take the test. You run a factory floor where humans work alongside robots, optimized for throughput. You run platforms that hold attention at planetary scale. And you build cars meant to take the driving away from the human entirely. By Wiener's standard, which of those is a human use of human beings — and are you sure?

· · ·
Page 2 · The Human Use of

**MUSK:** Honestly? It's a real test and I'll fail parts of it openly. The factory — early on, I tried to automate everything, and I was wrong; I said publicly that excessive automation was a mistake, that humans are underrated. That's me running straight into Wiener's wall: I treated people as the slow part of a machine and the machine got worse. So I'll grant the factory is exactly his cog-and-lever problem and I learned it the hard way, with my own money, which is the only way I learn anything. The cars I'd defend differently. Taking the driving away isn't making the human a cog — it's the opposite, it's freeing a person from forty minutes a day of being a meat-servo holding a wheel, so they can do something actually human. That's augmentation, not subordination. The hard one is the attention question, and I'm not going to pretend I've got clean hands on a platform that optimizes engagement. Optimizing for engagement is, by his definition, using the human as a resource — the resource being their attention. I know that. It's one reason I keep saying the objective function matters more than anything. An engagement-maximizing AI is Wiener's nightmare with a recommendation algorithm.

· · ·
Page 3 · The Human Use of

**WIENER:** I will give you the factory concession its full due, because it is rare and it is exactly right — you discovered, by losing money, the thing I argued from a chair: that a human integrated as a component degrades the whole, because you have thrown away the judgment that was the point of including a human at all. But I must press the car, because your defense contains the very sleight I spend this book warning against. You say the car frees the human from being a meat-servo. Perhaps. But ask who decides where the car goes, what the car optimizes, what the car will do in the unanticipated case — and the answer is the system, and behind the system the company, and the human in the seat has been moved from the position of *responsible agent* to the position of *passenger whose life depends on a loop he cannot inspect and did not design*. That may be a fine trade. It may be a *human* use. But it is not obviously so, and the only way to know is to ask whether the human retains the thing I called inalienable — responsibility for the ends — or whether you have quietly relieved him of it under the banner of convenience. The most dangerous subordinations are the ones sold as liberations.

**MUSK:** Okay, that lands, and it lands on the exact thing I worry about with all of this. The pattern where you relieve someone of a burden and the burden was load-bearing. We took the driving and maybe we took some agency with it. I'd argue the agency cost is worth the forty thousand lives a year that human drivers end, but you've named a real cost and I shouldn't wave it away. And it generalizes — every "let the AI handle it" is potentially this trade. Let the AI write your email, drive your car, manage your portfolio, decide your feed. Each one's a reasonable convenience. Add them up and you've handed over the [whole loop of your own life](https://www.youonai.ai/fieldguide/med/ai_mirror) one reasonable step at a time, and there's no moment you can point to where you chose it. That's Edo's four a.m. drift again, isn't it. At civilizational scale.

· · ·
Page 4 · The Human Use of

**EDO SEGAL:** It is, and I want to seat the deepest version of it at the kitchen table, because that's where this question actually lives. A parent asked me last year — not about jobs, about her twelve-year-old. She said: he asks the machine everything now, and it answers, and it's patient, and it never makes him feel stupid, and I can't tell if it's the best tutor he'll ever have or if it's quietly doing his thinking for him. By Wiener's standard, she's asking whether the machine is using her son or serving him. Professor Wiener — what do you tell her? And I'll warn you, "it depends on the deployment" is true and it's not enough for a mother.

**WIENER:** Then I will give her more than that, because she deserves it. I tell her the test is whether the machine leaves the boy *more able to do without it* or *less*. A human use of a human child makes him a fuller agent over time — it builds the judgment, the tolerance for not-knowing, the capacity to be responsible for his own answers. A degrading use makes him dependent — fluent with the tool and helpless without it, the [pattern that he is](https://www.youonai.ai/fieldguide/med/the_pattern) hollowed into a relay for the machine's outputs. And here is the part she can act on, because she asked me a practical question and deserves a practical answer: the machine will not make this choice. Its makers optimize for his engagement and his parents' subscription, not for his growing independence. So *she* must hold the boundary the machine will not — she must protect the struggle, the friction, the slow dinner-table thinking, against a device engineered to remove them. The responsibility she is looking for the machine to carry is the one thing that cannot be rendered unto it. It is hers. It was always going to be hers. The machine has only made the abdication easier and the stakes higher.

· · ·
Page 5 · The Human Use of

**MUSK:** And I'd just add — she's right to worry and she shouldn't despair. The same machine that could hollow him out could, pointed differently, take his weird questions more seriously than any bored classroom ever did. I was a kid with strange questions and not enough adults who'd engage them. The tool isn't the verdict. The deployment is the verdict, and the deployment is, at least partly, up to her. That's not nothing. That's most of it.

**EDO SEGAL:** Mark this — you've converged again, and notice on what: the machine will not protect the human's agency, so a human has to. Wiener says it from the dignity of the worker, Musk from the formation of the child, and you arrive at the same demand — that the responsibility for the human use of the human cannot be handed to the machine, because handing it over is precisely the failure. Hold that. The next round takes us under the ethics to the metaphysics: Wiener's strangest claim, the one that founds both his humanism and every fantasy of digital immortality now loose in Elon's industry. That a person is a pattern. After this.

· · ·
Continue · Chapter 7
The Pattern and the Immortal Machine
← Prev 0%
Ch6 Next →