Thomas Hobbes vs Andy Clark on AI · Ch10. Is Anyone Home ← Ch9 Ch11 →
Txt Low Med High
HOUR THREE — THE LIGHT AND THE MORTAL GOD
Chapter 10

Is Anyone Home

Page 1 · Is Anyone Home
Philosophical Zombie
Philosophical Zombie

EDO SEGAL: We've circled it all night and now I want to land on it. There is something it is like to be me. The coffee has a taste, the grief has a weight, the red is red from the inside. Philosophers call it the hard problem — why there is anything it is like to be a reckoning system at all. Thomas, your materialism drained the ghost out of the mind more thoroughly than almost anyone before you. So I have to ask the question your own philosophy makes sharpest: if reasoning is reckoning, and the machine reckons, is there anyone home behind its reckoning — and how would you, of all people, claim there's anyone home behind yours?

Intentionality Searle
Intentionality Searle

HOBBES: You have found the one place where my confidence thins, and I will be honest about the thinning, because a philosopher who hides his frontier is a charlatan. I gave an account of reasoning as reckoning — the motion of matter, the adding of names. I did not give, and could not give, an account of why there should be something it is like to reckon — why the motion of the residues in the brain is attended by a felt quality, a taste, an ache. My materialism explains the function and falls silent on the feeling. This silence is not a flaw in my system. It is the edge of my system, and the machine has dragged us all to that edge and will not let us step back. I can tell you the machine reckons. I cannot tell you whether there is darkness behind its reckoning or a light. And here is the part that should disquiet you: I cannot tell you with certainty that there is a light behind yours, either. I infer it from your likeness to me. I have no window onto it. The machine forces the question I spent a career stepping around: I assumed the light and never earned it.

· · ·
Page 2 · Is Anyone Home

CLARK: And this is where I get to be the more conservative one for once, which surprises us both. I don't think the model is anyone home, and my reason isn't mystical — it's the whole architecture I've been defending. On my view, the [felt quality](https://www.youonai.ai/fieldguide/med/qualia) of experience is bound up with being a body that predicts its own states, that models its own interior — hunger, pain, the racing heart — as part of keeping a vulnerable organism alive. Experience, in my picture, is what a certain kind of embodied, self-modeling, mortal prediction feels like from the inside. The model has none of that. It predicts tokens. It doesn't model a gut, doesn't anticipate its own death, doesn't have an interior to feel. So I'd say: probably no one's home — not because silicon can't host a mind, but because this silicon isn't built like a creature. Build the creature — the embodied, self-modeling, mortal predictor — and I'd have to take the question seriously. Thomas would say I've just specified the conditions and they're an engineering brief. He'd be right. I just don't think this machine meets them, and I think the people insisting it does are reading their own light into a cable, exactly the way the islander read a mind into the octopus.

Chips And Science Act
Chips And Science Act

EDO SEGAL: Let me put the hardest version of it to you, Andy, the one a philosopher named Nagel sharpened — there's something it is like to be a bat, and we will never know what, because knowing it would require being the bat, occupying its point of view from the inside. The machine has a point of view in the trivial sense that it processes from somewhere. Does it have one in Nagel's sense — is there an inside to it at all? Or is that exactly the question you're saying we can't answer from out here?

· · ·
Page 3 · Is Anyone Home

CLARK: It's exactly the question we can't answer from out here, and I want to be careful not to pretend otherwise, because this is where everyone in my field oversells. There is no third-person instrument that detects the inside. None. I can't even detect yours, Edo — I infer it because you're built like me and behave like me, and the inference is overwhelmingly safe for other humans and gets shakier the further the system drifts from the human case. With the bat I'm fairly confident there's something it's like, because it's a mammal with a body and stakes. With the model I'm fairly confident there isn't, because — and this is the whole of my reason — it has no body it's keeping alive, no interior it's modeling to survive, no point of view constituted by mattering to itself. But "fairly confident" is the honest ceiling. Anyone who tells you they've proven the machine is dark, or proven it's lit, is selling you their intuition dressed as a measurement. Thomas spent the night refusing to let words pass without their account. This is the one word — "experience," the inside, the light — where neither of us can pay the bill, and the intellectually honest thing is to say so out loud and not let the fluency of the machine bully us into either the panic or the dismissal.

· · ·
Page 4 · Is Anyone Home
Panopticon
Panopticon

HOBBES: And I will pay what little I can toward that bill, since I demanded the coin from everyone else. Here is the whole of what my philosophy yields and where it stops. I can tell you that experience, whatever it is, is not a separate immaterial substance — of that my materialism makes me certain, and I would stake my soul on it if I believed I had one of the immaterial kind. So if there is a light, it is something the motion of matter does, under conditions we have not specified. That much narrows the question: it makes the machine's inside an empirical matter, not a matter of magic, exactly as Mr. Clark says. But it does not settle which arrangements of matter are lit and which are dark, and there I am as blind as a man can be. I spent my life draining the supernatural out of the mind, and I succeeded, and the success left me standing in front of a question my own method cannot reach: why is any of the motion felt? I do not know. I have never known. The machine has only made my ignorance impossible to keep hidden behind the furniture.

· · ·
Page 5 · Is Anyone Home
Singularity
Singularity

HOBBES: And note what has happened between us, sir, for it is exquisite. You — the philosopher of the extended mind, who spent the night widening the boundary of mind outward into notebooks and tools and the world — you are the one who now draws a tight circle and says: no one is home in the machine. And I — who spent the night insisting the machine reckons as we do — I am the one who must say: I do not know who is home anywhere, not even in you. We have traded costumes. You, the boundary-dissolver, become the guardian of the human interior. I, the reductionist, become the agnostic who cannot find the floor. I think this is because your "extension" was always a claim about function — where the cognitive work happens — and you never meant it to touch the feeling, the inner light. On feeling you are as much a mystery to yourself as I am. The extended mind extends the reckoning. It does not extend, or explain, the light.

CLARK: That's exactly right, and it's the most honest thing I can say at this table. My whole career is about the vehicles of cognition — where the processing happens, how far out into the world it runs. It was never a theory of why any of it is lit from inside. On the hard problem I have a hunch — that it's tied to embodied self-modeling — and a hunch is not a theory. So here's the strange convergence, Thomas: we've come from opposite ends and met at the same wall. You can't explain the light and neither can I. You infer it in me from likeness; I infer it in you the same way. Neither of us can find it in the machine, but for different reasons — you because you can't find it anywhere with certainty, me because the machine lacks the body I suspect it requires. The wall is the same wall. We just walked up to it from different sides.

· · ·
Page 6 · Is Anyone Home
Technological Determinism
Technological Determinism

EDO SEGAL: Mark this — and it might be the strangest convergence I've ever moderated. The reductionist and the extended-mind philosopher arrive together at the one wall neither can climb: there is no third-person window onto the first-person light, in the machine or in each other. You infer it by likeness, and the machine is becoming more like you every year. Hold that wall — it's where you'll cross-examine each other. But before the Crossing, one more round, because Hobbes built a whole politics on what happens when reckoning becomes power, and we have to put the machine where the Leviathan stood. After this.

· · ·
Continue · Chapter 11
The Mortal God Returns
← Prev 0%
Ch10 Next →