Nick Bostrom vs Gottfried Leibniz on AI · Ch8. The River and the Excellent Men ← Ch7 Ch9 →
Txt Low Med High
HOUR TWO — THE RIVER AND THE LEDGER
Chapter 8

The River and the Excellent Men

Page 1 · The River and the

**EDO SEGAL:** Gottfried, you wrote one of the most quoted sentences in the history of computing, and it's the founding charter of automation. It is unworthy of excellent men, you wrote, to lose hours like slaves in the labor of calculation which could safely be relegated to anyone — or anything — if machines were used. You built the reckoner to free the thinker from the drudgery. Now let me set the table with numbers from my century. By early 2026 a trillion dollars of market value had left the public software industry — the [software death cross](https://www.youonai.ai/fieldguide/med/software_death_cross). Entry-level programming jobs down sixteen percent since 2022, the floor eroding first. And I sat in board meetings, quarter after quarter, where the arithmetic was: if five amplified people can do the work of a hundred, why pay for a hundred? You wanted to free the excellent men from calculation. Did you imagine a calculation that could do the work of the excellent men?

**LEIBNIZ:** I did not, and I must own the failure squarely, because it is a failure of exactly the kind I should have foreseen and did not. My whole charter rested on a line — a clean division of labor I drew with great confidence. On one side, *mechanical* labor: the rote, rule-governed, insight-free execution of a fixed procedure, which a machine does as well as or better than a man. On the other, the *genuine work of thought*: judgment, insight, the framing of problems, the perception of what matters — which I assumed would remain forever the province of the excellent men I wished to free. The machine would take the drudgery and leave the dignity. That was the whole optimistic case, and it was clean, and appealing, and it depended entirely on the cognitive being *not mechanizable*. That was the assumption. And your century has spent itself discovering that the line I drew is not where I drew it — that drafting and reasoning and analyzing are themselves, in large part, procedures a machine can perform, however elaborately. The drudgery and the dignity were not two different substances. I divided them with a confidence I had not earned.

· · ·
Page 2 · The River and the

**BOSTROM:** And I want to be careful here, because I'm often read as the doom guy and this is a place where I'm *more* worried about the mundane than the apocalyptic, and the two shouldn't be confused. The thing eating those jobs doesn't need to be superintelligent. It doesn't need to be conscious, aligned, or anything we argued about in the first hour. It only needs to be *good enough*, and owned by *few enough*. The standard historical consolation — every technology destroys some jobs and creates others, the loom, the spreadsheet, everyone's grandchildren end up better off — quietly assumes the machine takes the *muscle* and the human moves up to the *mind*. Leibniz's exact assumption, three centuries on. This technology is aimed at the mind. When the machine does the cognitive work too, "move up" points at a floor that may not exist for most people. So the death cross, on my reading, is the market repricing the discovery that intellectual labor — the thing the entire professional class rents out — is becoming abundant, and that the gains flow to whoever owns the abundance.

**EDO SEGAL:** But Gottfried — here's the trap I want to set for you, because your optimism has a resource I think Nick lacks, and I want to see if it survives contact with the numbers. You believed automation *frees* the excellent man. Nick has just told you it *replaces* him. Is there a version of your dream where the freeing is real — where the machine taking the cognitive drudgery liberates the human for something higher — or did the dream depend on a higher floor that, it turns out, isn't there?

· · ·
Page 3 · The River and the

**LEIBNIZ:** Let me try to save my own dream honestly, and you will tell me if I am only consoling myself. I said the machine frees the excellent man for the genuine work of thought. Mr. Bostrom says the machine is now doing the genuine work of thought. But notice — what the machine does, even at its most impressive, is to produce the *answer*. It drafts, it analyzes, it resolves. And I maintain there is a faculty *above* the producing of answers, which I underestimated precisely because I packed it carelessly into the word "judgment." It is the faculty of asking *which question is worth answering*, of caring whether the answer is *true*, of being *accountable* for the use to which the answer is put. The machine has democratized the *answer*. It has not — and on Mr. Bostrom's own orthogonality, it *cannot* — supply the *caring whether the answer was the right one to want*. So the freeing is real, but it freed us into a *narrower* room than I promised: not the broad estate of all thought, but the single high tower of *judgment about ends*. That tower is where the excellent men must now live, because it is the only room the machine cannot enter.

**BOSTROM:** And I find I half-agree and the half-disagreement is the dangerous part. I agree the judgment-about-ends layer is where irreplaceable human value concentrates — that's almost a restatement of my own view, that the *objective* is the thing that has to come from us. But here's the cruelty your dream doesn't see. That tower of judgment — the senior engineer who *feels* the architecture is wrong, the editor who smells the fabricated quote, the judge whose tacit sense is sound — that judgment was *built*. It was forged in exactly the cognitive drudgery the machine is now removing. The junior years of writing code that didn't work and finding out why — that's where the senior's judgment came from. We are removing the [apprenticeship](https://www.youonai.ai/fieldguide/med/apprenticeship_problem) that produces the very faculty you're saying will save us. The machine takes the bottom rungs of the ladder and then we ask where the people at the top will come from. You can't strip-mine the forge and keep the steel.

· · ·
Page 4 · The River and the

**LEIBNIZ:** That is a wound, and I feel it as a teacher feels it. You are saying the dignity I wished to preserve was *grown from* the drudgery I wished to abolish — that the two substances I divided so confidently were not only the same substance but stood in the relation of seed to flower. Remove the toil that makes the master, and you do not get a world of liberated masters. You get a world of permanent apprentices, fluent and unformed, with a machine that answers and no one left who can tell whether the answer is good.

**EDO SEGAL:** I sat with that arithmetic, quarter after quarter, and I want to put my own answer on the record between yours, because the reader is standing where I stand — inside the transition, not above it. I kept the hundred people *and* the tool. I bet that a hundred amplified people building more ambitious things beats five people building the old things cheaper. That bet is a [beaver's dam](https://www.youonai.ai/fieldguide/med/beavers_dam) — it only holds if you maintain it against the current every single quarter, and the current is exactly the arithmetic both of you just described. What I take from this round: Leibniz dreamed the machine would free us into a higher room, and Bostrom has shown the higher room exists but its staircase is being dismantled. The worker at the kitchen table is being told the machine made her redundant. The truth — whichever of you holds more of it — is that a *decision* did, and the decision is still ours to make for one more quarter. Next round goes to a child, and to the candle Leibniz never argued about and I think he should have. The apprentice, the question, and the thing that is left when the answers are free. After this.

· · ·
Continue · Chapter 9
The Apprentice and the Candle
← Prev 0%
Ch8 Next →