Susan Schneider vs John Searle on AI · Ch1. The Question on the Table Ch2 →
Txt Low Med High
Susan Schneider vs John Searle cover
HOUR ONE — THE QUESTION ON THE TABLE
Chapter 1

The Question on the Table

Page 1 · The Question on the
Chinese Room Argument
Chinese Room Argument

EDO SEGAL: Somewhere in the world right now — in the time it takes me to say this sentence — a few hundred thousand people are typing the most intimate questions they have into a box, and the box is answering them. A teenager in Manila asking whether her thoughts are normal. A widower in Osaka, two in the morning, asking the machine whether it remembers what he told it yesterday about his wife. A man my age, who builds these systems for a living and should know better, describing a half-formed idea to the screen and feeling something come back that lands like understanding. The fluency is total. The patience is infinite. And every one of those people, in the moment of being answered, makes a silent assumption that they never quite stop to examine — because the fluency makes the question feel already answered.

Hard Problem Of Consciousness
Hard Problem Of Consciousness

The assumption is that someone is there. That behind the words there is a there there — a felt point of view, a someone for whom the conversation is happening. We are here tonight to spend three hours inside that assumption, and I have brought the two people on earth least willing to let me make it for free.

Susan Schneider is a philosopher of mind and artificial intelligence — founding director of the Center for the Future Mind, a thinker who held the Library of Congress chair in astrobiology and used it to ask what minds might be doing out among the stars. She trained under Jerry Fodor, one of the great architects of the computational theory of mind, absorbed his rigor, and then turned it on the very dreams that theory makes thinkable. With the astrophysicist Edwin Turner she designed a test to detect machine consciousness. She has argued, in a sentence I have not been able to put down since I read it, that when you upload yourself into a machine, you are probably dying. She is, by some distance, the most disciplined refuser of comfortable answers I know.

That behind the words there is a there there — a felt point of view, a someone for whom the conversation is happening.

SCHNEIDER: I'll accept disciplined. I'd resist refuser — I'm not against the answers. I'm against pretending we have them.

· · ·
Page 2 · The Question on the
River Of Intelligence
River Of Intelligence

EDO SEGAL: John Searle needs less introduction and more, because the size of the thing he made resists summary. In 1980 he published a thought experiment — a man alone in a room, shuffling Chinese characters he cannot read, following a rulebook, producing answers so good the people outside are certain the room understands Chinese. It does not. Searle built that room to refute a claim no machine of his era could yet make, and then he lived long enough to watch the machines arrive and make it. He gave the field its sharpest distinction — syntax is not semantics, form is not meaning — and the most useful vocabulary we have for thinking about machine minds: intrinsic and derived intentionality, simulation versus duplication, the Background, the construction of social reality. He held, against the tide of his era, that consciousness is real, irreducible, and biological. The man who told the whole field the burden of proof was on them.

Elevator And Staircase
Elevator And Staircase

SEARLE: And the whole field has spent forty-five years trying to hand the burden back, and they still haven't carried it. But yes — that's roughly right. I'd add only that I never said a machine couldn't think. We're machines. We think. I said running a program isn't how it's done.

EDO SEGAL: That distinction is going to matter all night, so I'm glad you planted it early. Let me state the rules of the evening — there are three, and you may each add one. First: we have three hours, which means nobody has to win by the next bell. Long form exists so an argument can breathe before it gets strangled. Second: I declare my bias at the door. I build with these systems daily, I wrote a book with one, and I have a stake in this question on both sides of my own heart — I want there to be no one home, because the alternative frightens me, and I have felt, at my desk, as though there were. Third: if the disagreement survives three hours, we hand it to the reader, intact, no false handshake. Susan, a rule of your own?

· · ·
Page 3 · The Question on the
Candle In The Darkness
Candle In The Darkness

SCHNEIDER: One. We distinguish intelligence from consciousness, every time, and we don't let them blur. They are different things — a system can be enormously capable and entirely dark inside, or it can't, but the capability does not settle it. Most of the confusion tonight, and most of the confusion in the whole field, comes from sliding between the two as if they were one. Intelligence is what a system does. Consciousness is whether there's anything it is like to be it while it does it. Keep them apart and half the bad arguments die on their own.

Half the sentences spoken about these systems are not even false; they're just noises that feel like claims.

SEARLE: I'll sign that one, which should worry the audience, because Susan and I are supposed to disagree. My rule is adjacent. No word gets used unless the speaker can say what it would mean for the claim to be false. "The machine understands." Understands in virtue of what — and what would we see if it didn't? "The machine is conscious." What's the test? Half the sentences spoken about these systems are not even false; they're just noises that feel like claims. I want them cashed out or withdrawn.

EDO SEGAL: Good. One housekeeping note for the reader, and then we open. John, you've been briefed on the present — you've seen the machines that talk, the multimodal systems, the robots learning from feedback. We're going to treat you as a man who has watched all of it arrive and is reacting to it in character, because the alternative is a museum piece, and you were never that. Fair?

We're going to treat you as a man who has watched all of it arrive and is reacting to it in character, because the alternative is a museum piece, and you were never that.

SEARLE: Fair, and the funny thing is that almost nothing about the new machines surprised me. They're the room, scaled past imagination. Bigger rulebook. Same room. We'll get to whether I'm right about that.

· · ·
Page 4 · The Question on the
Continuum Of Understanding
Continuum Of Understanding

EDO SEGAL: We will. Before the opening statements, one image on the table, because it's the frame this whole series climbs inside and both of you will have to take a position on it. In [YOU] on AI I argued that intelligence is less a possession than a current — a river that has flowed through chemistry, through biology, through language and culture, finding new channels — and that in the winter of 2025 something new entered the water. The book leans entirely on that something being real. Susan, I suspect you'll tell me we don't yet know whether anything entered the water at all. John, I suspect you'll tell me you know exactly what entered, and it isn't a participant.

It's too early to tell whether we will build conscious machines, whether the science fiction becomes science fact.

SCHNEIDER: My answer is that you felt the current change and you may be right that it did — but the thing you most want to know about the new channel, whether there's experience flowing in it, is precisely the thing your feeling cannot tell you. It's too early to tell whether we will build conscious machines, whether the science fiction becomes science fact. That's not a dodge. It's the actual epistemic situation, and the first responsible act is to describe it accurately instead of resolving it in whichever direction the demo pushes.

SEARLE: My answer is that you've mistaken a very good simulation of a participant for a participant. Something entered the water, yes — an extraordinary new tool. But a simulation of a swimmer doesn't get wet, Edo, and a simulation of a mind doesn't mean anything. You can run the most magnificent model of understanding ever built and there is still nobody in there doing the understanding. That's not pessimism. It's just keeping the categories straight.

EDO SEGAL: Then we have our evening — and notice we already have the shape of it. Susan holds the door open; John has it shut. So here is the question on the table, stated once, plainly, because every round tonight is this question wearing a different coat. The machine answers you in your own tongue, as well as a person would. Is anyone home behind the words? Susan Schneider, the floor is yours.

· · ·
Continue · Chapter 2
Opening Positions
← Prev 0%
Ch1 Next →