Hannah Arendt vs Daniela Rus on AI · Ch3. Labor, Work, and the Thing the Machine Was Built to Take ← Ch2 Ch4 →
Txt Low Med High
HOUR ONE — THE DEED AND THE DOER
Chapter 3

Labor, Work, and the Thing the Machine Was Built to Take

Page 1 · Labor, Work, and the
Apprenticeship Problem
Apprenticeship Problem

EDO SEGAL: I want to start this round with a confession, because the best questions I know come out of wounds. Last winter I stood in a room in Trivandrum with twenty of my engineers and watched each of them become capable of more than all of them together — because for the first time the machine met them in their own language, took their half-finished intentions and returned working systems. I wrote that this was a liberation. And then I came home and could not sleep, because I had also watched something subtler: the part of the work that used to form them — the friction, the wrong turns, the slow earning of judgment — had quietly been removed along with the toil. Hannah, you gave us the only vocabulary precise enough to ask what actually happened in that room. Your three activities — labor, work, action. Which one did I automate? And did I take something I didn't mean to?

You automated more than one thing at once, and that is the trouble — the machine does not respect my distinctions, it cuts across them.

ARENDT: You asked the exact right question, which is rarer than you know, so let me honor it with precision. You automated more than one thing at once, and that is the trouble — the machine does not respect my distinctions, it cuts across them. Some of what your engineers did was labor: the repetitive plumbing, the boilerplate, the toil consumed as fast as produced. Automating that is pure liberation; I have no quarrel with it and never did. Some of it was work, in my sense — the fabrication of something durable, a built artifact that stands. And here the machine is more ambiguous, because it can fabricate the durable thing while bypassing the maker, and the made world matters partly because a person made it and stands behind it.

· · ·
Page 2 · Labor, Work, and the

But what kept you awake is the third thing, and you were right to lose the sleep. Inside what looked like labor — the four hours of plumbing — was hidden a small quantity of action and judgment: the accidental learning, the moment your engineer formed a question by being stuck, the friction that was not an inefficiency in the work but the forming of the worker. The machine removed the toil and, in the same motion, removed the forge. This is my oldest warning in a new dress. I feared modernity was collapsing all three activities into the lowest — reconceiving everything, even action, as labor: as process, as throughput, as something to be optimized and consumed. Your machine is the most powerful engine of that collapse ever built. It treats judgment as a prediction task and decision as optimization and the disclosure of who-one-is as the generation of content. It does not free you for higher things. It paves the place where the higher things grow.

It's that the boring part and the forming part were braided together, and you cannot pull one thread without pulling the other.

EDO SEGAL: So let me hand that back to you sharpened, because I want to feel its weight. You're saying — literally — that the danger is not that the machine takes the boring part. It's that the boring part and the forming part were braided together, and you cannot pull one thread without pulling the other. Is that the version you find most compelling?

ARENDT: It is the version I would defend to my last breath. The apprentice does not become a master by being handed mastery. He becomes a master through ten thousand hours in which the toil and the judgment are inseparable — and a civilization that strips out the toil to be efficient will discover, one generation later, that it has also stripped out the masters, and that there is no one left who can judge whether the machine is right. You will have automated not the labor but the production of judgment itself, and you will not notice until you need a judgment and find the cupboard bare.

· · ·
Page 3 · Labor, Work, and the

RUS: I want to agree with the warning and then take the braid apart, because I think the braid is not as tight as Hannah needs it to be, and the engineering is where you find out. Yes — historically, judgment was learned inside toil, because that was the only place it could be learned. The junior developer's pattern recognition came from hours of writing code that broke. But notice the contingency in that. The toil and the forming were braided not by some law of the human spirit but by the accident that we had no better way to teach. The question for a builder is never "was the friction historically necessary" — it's "can we build a better forge." And that is a design problem, not a tragedy.

Here is what I mean concretely. My liquid networks are interesting partly because they are small enough to inspect — nineteen neurons, and you can actually see what the network is attending to, turn its decision into something a human can examine. That is the opposite of the inscrutable black box. The same instinct applies to your forge problem. If the old apprenticeship taught judgment by accident, inside toil, then the task is to teach it on purpose, by design — to build tools that make the reasoning visible, that put the human back in at the moment of judgment specifically, that turn the four hours of plumbing into ten minutes of plumbing plus fifty minutes of the harder, higher thing. Hannah is describing a real loss under thoughtless deployment. I'm describing the deployment that takes her warning as a specification. The friction was the curriculum, she says. Fine. Then let's design a better curriculum, not mourn the loss of an accidental one.

· · ·
Page 4 · Labor, Work, and the

ARENDT: But you cannot design judgment, Daniela — that is the whole point, and your phrase "teach it on purpose" smuggles the error. Judgment is precisely the faculty that handles what no rule anticipated, the reflective confrontation with the particular that no procedure can specify in advance. The moment you can build a tool that "teaches it," you have converted it into something rule-shaped, which means it is no longer judgment but its simulation. A curriculum that makes the reasoning "visible" makes visible only what can be made into a rule — and the cases that most demand judgment are exactly the ones the rule did not foresee. You will build a magnificent school for everything except the thing that matters.

RUS: Then we have located a real disagreement, and I want to mark it precisely rather than smooth it. You believe judgment is, in principle, non-transferable — that it lives only in the unrepeatable friction of a particular human life and dies a little every time you make it efficient. I believe judgment has structure, and that structure can be partly externalized — into tools, into better feedback, into systems that surface the right hard case at the right moment to the right human. Not all of it. The deepest part, the part that decides what is worth caring about, no. But a great deal of what we romanticize as ineffable judgment is, in my experience, reliable reasoning under conditions we have not bothered to make explicit. I've spent thirty years making implicit physical competence explicit enough to put in a robot. It is humbling work, and it does not always succeed. But every time it succeeds, a piece of what looked like ineffable judgment turns out to have been a procedure we simply hadn't written down.

· · ·
Page 5 · Labor, Work, and the

EDO SEGAL: Hold there, because Daniela just said something that cuts to the bone of the whole evening and I don't want it to slide past. She said: a great deal of what we call judgment is reliable reasoning we never made explicit. Hannah, that's your nightmare and her vocation in one sentence — what she calls "making explicit," you'd call "converting action into process." Mark that. It returns in every round. But the next round goes straight to the wound under this one — the courtroom, the clerk, and the machine that has his defect built in. The banality of optimization. After this.

· · ·
Continue · Chapter 4
The Banality of Optimization
← Prev 0%
Ch3 Next →