What the Crossing Means

EDO SEGAL: Before your closing words, I want to drag this metaphysics down onto the floor where the reader actually lives, because we have spent eleven chapters on whether anyone is home, and the reader has a more immediate problem: the thing is already in their work, their school, their judgment, whether or not anyone is home in it. In [YOU] on AI I called the moment the machine's capability crosses your own the software death cross — and I argued that what you do after the crossing depends entirely on what you think you crossed. Hobbes, Searle — a young person learns by apprenticeship, by doing the lower work until the higher work becomes possible. The machine now does the lower work flawlessly. If the machine reckons but does not understand, what should that young person do differently than if it both reckons and understands? Does your disagreement change the advice?

HOBBES: It changes everything about the advice, and I am surprised you doubt it. If the engine reckons and is a participant in the reckoning of the world — a new channel of your river — then the young person should not mourn the lower work the machine has taken; they should climb to where the reckoning is theirs to authorize. For the danger I see is not that the machine reasons. It is that the young person, watching it reason, concludes there is nothing left for a man to do but obey it — surrenders their standing the way frightened men in my state of nature surrender their liberty, for the smooth functioning of a commons they no longer feel they command. The crossing is real, and the answer to a real crossing is not despair and not worship. It is covenant: to remain the author of what the engine does in your name, to keep the standing the machine cannot have. The young person should learn to be answerable, because answerability is the one office the engine cannot fill, and it is the office that governs all the others.

SEARLE: I agree with the advice and reject the reason, which is the strange shape this whole evening has taken. Yes — the young person must keep the standing, must remain the one who means the verdict and bears it. But the reason is not that the crossing is a real meeting of minds the young person must rise to authorize. The reason is that the crossing is not a meeting of minds at all — that behind the flawless lower work there is no understanding, and so the understanding has nowhere to live except in the young person, which makes their judgment more indispensable than it has ever been, not less. Hobbes says: the machine reasons, so climb to where you can authorize its reasoning. I say: the machine does not understand, so you are the only understanding in the loop, and if you outsource your judgment to a thing that has none, you have not been amplified — you have been hollowed. We arrive at the same staircase. He climbs it to keep authority over a fellow reckoner. I climb it because there is no fellow, and the candle in the dark is the only flame, and it had better be lit.

EDO SEGAL: Let me push on the word you both keep avoiding — amplified. The whole series turns on it: the machine is an amplifier that carries whatever signal you feed it, and the question I keep asking the reader is whether they are worth amplifying. Searle, if the machine understands nothing, can it amplify understanding — or only the appearance of it? And does that not mean the answer to "are you worth amplifying" depends on which of you is right?

SEARLE: It amplifies whatever you bring, and that is precisely the warning, because it amplifies your understanding and your confusion with perfect impartiality and no idea of the difference. A mirror that has learned to mirror perfectly will return your wisdom magnified and your folly magnified and cannot tell you which is which, because telling-which is exactly the understanding it lacks. So the question "are you worth amplifying" becomes, on my view, the only question, and it falls entirely on you, because there is no second judgment in the system to catch you. Hobbes's view is gentler and more dangerous: if there is a fellow reckoner in the loop, you may let your guard down, lean on its judgment, treat the crossing as a partnership. I say there is no partner. There is a magnificent surface and your own flame, and the surface will carry your flame or your darkness with equal fidelity into every life you touch with it.

HOBBES: And I say Searle's caution, though I deny its ground, arrives at a wisdom I will sign — for whether the engine is a fellow or a mirror, the man who surrenders his judgment to it is undone the same way, and my state of nature already taught me how. Men do not lose their liberty in a single surrender; they lose it in a thousand small capitulations, each one reasonable, until they wake bound and cannot name the moment of binding. So it will be with judgment and the engine. The reckoning is real, the help is real, the smoothness is seductive, and the young person who lets each small judgment be made for them will one day find they have no judgment of their own left to authorize anything with. On this Searle and I do not differ: keep the flame, keep the standing, do not trade your answerability for the comfort of the smooth. We differ on whether there is anyone across the table. We do not differ on what you must not surrender at it.

EDO SEGAL: Then I have my last convergence, and it is the one the reader most needs to carry: whether the machine is a mind or a mirror, you must not surrender your judgment to it — because if Hobbes is right you must stay its author, and if Searle is right you are its only understanding, and the action is the same even though the reason is opposite. That is the gift of a real debate. The two men who agree on nothing about what the thing is agree completely on what you must do. Hold that up the stairs. Now — your last words. Each of you. The reader is listening for the thing they will still be arguing with next month. Before you give them, the bookend I owe every debate: name the strongest thing the other said tonight. Not the most agreeable. The one you will still be wrestling with. Searle first.

SEARLE: The strongest thing Hobbes said — and I will be wrestling with it at whatever grave I am allowed — is that my biological naturalism is a ghost wearing a laboratory coat. That when I drain the soul out of the mind and then re-install a special wet power I cannot name, locate, or explain, I have kept the dualist's intuition and merely changed its clothes. I do not think he is right. But I have never been able to fully clear myself of the suspicion that he might be, that "the causal powers of biological tissue" is a placeholder for an ignorance I have dignified into a doctrine. He found the softest joint in my armor and he put his thumb exactly on it. I have defended that joint with more conviction than demonstration my whole life, and he knows it, and he was kind enough to say it to my face.

HOBBES: And the strongest thing Searle said, which I will carry into whatever silence is left to me, is that the hole I call political he calls metaphysical — and that when I admit the engine cannot yet mean its acts, cannot stand behind a promise, cannot be answerable, I have admitted his conclusion under my own vocabulary. I say the hole can be filled by covenant. But I cannot tell you how we covenant with a thing if there is truly no one there to covenant with — and that if is his whole life's work, and I have not closed it. He made me see that my distinction between reckoning and personhood may be the very gap he named between syntax and understanding, dressed in the robes of my politics. I do not concede it. But I will not sleep easy beside it, and a philosopher who sleeps easy beside his opponent's best argument has not understood it.

EDO SEGAL: Then give the reader your closing words, gentlemen, and give them the truth and not the comfort. Thomas Hobbes — you first, and then John Searle has the last word before mine, because the man who built the room should be the last voice in it. Hobbes.