Thomas Hobbes vs James C Scott on AI · Ch8. The War of All Against All ← Ch7 Ch9 →
Txt Low Med High
HOUR TWO — THE EYE AND THE WAR
Chapter 8

The War of All Against All

Page 1 · The War of All
Concentration Of Power
Concentration Of Power

EDO SEGAL: Mr. Hobbes, this is your round. The competition to build advanced AI — labs and nations racing, each unable to slow because a rival might not, safety skipped because waiting is losing. You described this three centuries before the word "arms race" existed. Lay it out, and then I'm going to let Professor Scott tell you why your cure is worse than your disease.

It is the state of nature, exactly and without metaphor, and it is the proof of my entire philosophy playing out in real time.

HOBBES: It is the state of nature, exactly and without metaphor, and it is the proof of my entire philosophy playing out in real time. Recall the three causes of quarrel: competition, diffidence, glory. The labs invade for gain, fearing to be overtaken; the nations invade for safety, fearing a rival's decisive advantage; both for the reputation of being first. The deepest driver is diffidence — fear. Every actor would, in many cases, prefer the slower and safer course. None can afford to be the one who restrains while others do not, because to restrain is to be overtaken, and to be overtaken in this domain may be final. So they race, not out of wickedness but out of reason, each responding correctly to a situation with no common power above it. This is why moralizing fails. You cannot ask the racers to be responsible; they are being responsible, to their own survival, in a condition that makes restraint suicidal.

And the remedy is the only one there has ever been, the one I have proposed for everything tonight: a common power. Some authority able to hold all the competitors in awe, so that none need fear being the lone defector punished for restraint. Covenants without the sword are but words, and of no strength to secure a man at all. Treaties between racing labs and rival nations, with no power to enforce them, are words. They can coordinate at the margin and they cannot escape the structural logic of the war, because any party that expects others to defect has reason to defect first, and the agreement contains no sword. The war ends when, and only when, a power exists to end it. That is not pessimism. That is the most constructive sentence in political philosophy, because it tells you exactly what to build.

· · ·
Page 2 · The War of All

EDO SEGAL: Professor Scott. The race is real. The treaties are words. What's wrong with the referee?

SCOTT: Nothing's wrong with the idea of a referee. Everything's wrong with what the referee becomes, and here's the trap that Hobbes has walked us into so elegantly all night that I have to name the whole structure or we lose. He says: the war needs a common power; the common power must be unified to be effective — because a divided sovereign isn't sovereign, the disputes between the powers become new wars. Therefore the cure for the AI race is concentration: a single dominant authority powerful enough to set and enforce the rules. And every step follows from the one before. I can't break the chain link by link. What I can do is tell you where it ends, because I've been to the end of that chain a hundred times in the historical record.

It ends with the concentration of power that is the most dangerous thing a human society can build, now fused with the most powerful seeing-and-sorting machine ever made. Hobbes's cure for the war is a single, unified, absolute authority over the technology that can read every transaction, predict every movement, and settle every dispute. He calls it the mortal god. I call it the high-modernist state with a god's-eye view and no underbrush left to stop it — every condition of catastrophe assembled in one artifact. The war is real, Hobbes. I've conceded it all night. But your cure is to build the very thing whose track record is the famines and the dead forests and the suffocated cities — and to make it absolute, and to give it the eye. You're so frightened of the war that you'd build the peace that kills more people than the war ever did. The Ukrainian famine wasn't the war of all against all. It was the plan. It was a unified sovereign with a legible model of agriculture, enforcing it absolutely, deaf to the peasant who knew. That's your mortal god. I've seen its corpses.

· · ·
Page 3 · The War of All

HOBBES: You compare my sovereign to Stalin and call it an argument. It is not. Stalin was not too much sovereign; he was a sovereign who failed his office — who used the power for the glory of the state and the party rather than the safety of the people, and who, fatally, severed the nerves that would have told him the truth from below. I have agreed all night that the deaf sovereign is doomed; the famine is the deaf sovereign's signature. But the cure for a sovereign that does not hear is not no sovereign — it is a sovereign that hears. And here is the question you must answer, because your whole position rests on dodging it: if not a common power, then what? The war is real, you concede it. The treaties are words, you have not denied it. So what holds the racers in awe? A thousand local dams? A dam does not stop an arms race between superpowers. Métis does not deter a defector with a decisive weapon. You have a beautiful answer for the village and no answer at all for the war that consumes villages. Name the structure that ends the race, or admit the race ends in the catastrophe you also fear.

· · ·
Page 4 · The War of All

SCOTT: [pause] That's the hardest question you've put to me, and I'm not going to dodge it, because dodging it is what gives high modernism the win by default. Here's my honest answer. I don't have a single clean structure, and I distrust anyone who says they do, because the single clean structure is exactly the high-modernist reflex I've spent my life warning against. What I have is a direction, and it's the opposite of yours: not concentration but redundancy. Not one unified eye but many overlapping powers, deliberately kept plural, deliberately kept partly illegible to one another, so that no single one can impose its plan on the whole — the way a polyculture survives the blight that kills the monoculture. You call divided power a recipe for war. I call it the only insurance against the catastrophe of the perfected plan. Yes, it's messier. Yes, it coordinates worse. Yes, it might fail to stop a determined defector — and that terrifies me, I'll own it. But a world of plural, jostling, mutually-checking powers has survived every blight. A world of one perfect sovereign has the failure mode of the spruce plantation: magnificent, legible, and dead in a generation when the one thing it didn't foresee arrives.

EDO SEGAL: Let me name the genuine impasse, because we've reached bedrock and I won't paper over it. Hobbes's chain is valid — if the race is a state of nature, the cure is a common power, and a common power must be unified to work. Scott can't break a link, so he rejects the conclusion and accepts the cost: a plural world that coordinates worse but can't be killed by a single mistake. Hobbes accepts the cost of concentration — the mortal god might dominate — because the war is certain and the domination is only possible. You have traded certainties for risks in opposite directions. That's not a failure of the debate. That's the actual shape of the choice, and the reader is now standing exactly where you've left them.

· · ·
Page 5 · The War of All

SCOTT: That's the fairest statement of it anyone's made, and I'll add only this: he's betting the sovereign stays good. I'm betting it doesn't. And the whole historical record is the story of how that bet comes out.

HOBBES: And the whole historical record is also the story of the war that returns the moment the sovereign falls. He counts the bodies of the plan. I count the bodies of the chaos. The honest reader must count both piles, and they are both very high.

EDO SEGAL: Both piles are very high. Hold that — it's the truest sentence of the night. Next round we go up one floor, to the place the seeing turns inward: not what the machine does to the order around you, but what it does to you — to the part of you that stays illegible, the inner thing that refuses to be a number. The candle, the squint, and the self that won't be seen. After this.

· · ·
Continue · Chapter 9
The Self That Will Not Be Seen
← Prev 0%
Ch8 Next →