The Crossing

EDO SEGAL: The floor is open. Ask each other the thing you've been wanting to ask since the first round. I'll only speak if the room catches fire. Thomas, you've been holding something.

HOBBES: I have. Mr. Clark, I want the mechanism, and I will not accept a metaphor in its place. You say the mind "extends" into the notebook, the tool, the machine. You say the boundary "moves." These are pictures. Give me the engine. When you reckon with a pen in your hand, what crosses the skin? Either there is some motion that passes from brain to paper and back — in which case it is all one reckoning system and I have no quarrel, but then you cannot say the machine is excluded merely for being silicon. Or nothing crosses, the paper is a mere instrument the brain consults — in which case your extension is a figure of speech and the mind stays in the skull after all. Which is it? You cannot have a mind that extends when it suits your argument and contracts when it suits your fear of the machine.

CLARK: Fair — and I'll give you the engine, no metaphor. What crosses isn't a substance, it's a functional loop. The criterion is the parity principle: if a process running outside the skull plays the same role that, run inside, you'd unhesitatingly call cognitive — and if it's reliably available, automatically trusted, and woven into the agent's habits — then it's part of the cognitive system. Not because something mystical leaks across the skin, but because the skin was never the relevant boundary. The boundary of a cognitive process is wherever the process runs, and processes don't respect anatomy. So here's my answer to your trap, and watch that it doesn't catch me: I do not exclude the machine for being silicon. I've said all night I'd extend into it the moment it meets the conditions — reliable, trusted-for-good-reason, transparent in its failures. The machine isn't excluded for its substance. It's excluded, right now, for failing the reliability condition: it's confidently, opaquely wrong in ways a notebook never is. The day it's as reliable and transparent as my own memory, my mind extends into it and I say so without flinching. Your trap assumes I'm protecting the skin. I'm not. I'm protecting the condition. That's a very different fence.

HOBBES: Then I have you, sir, or you have yourself. For if the only thing excluding the machine is its present unreliability — a defect of degree, mendable by engineering — then you have conceded my entire case and kept only a complaint about the current model's quality. The machine is excluded today for being a poor reckoner, not for being a reckoner. Improve the reckoning and your own criterion admits it into your mind. You are not, after all, the defender of a human interior the machine can never enter. You are an engineer with standards, waiting for a better product. Welcome, Mr. Clark, to my side of the river. You arrived by your own boat.

CLARK: No — and here's the counter, and it's the hinge of everything I've said. You're collapsing two conditions into one. Reliability is mendable by engineering, yes. But the other condition — that the resource be answerable to my purposes, anchored in my stakes — is not a quality you scale into. A perfectly reliable machine that answers to its builder's goals, or to no one's, doesn't become part of my mind by getting more accurate. It becomes a more effective colonizer of it. The notebook extends Otto because it's his — it holds what he put there, it has no agenda. An active, anticipatory machine optimized for engagement or persuasion has an agency that isn't his, and folding it into the self means folding a divergent will into yourself. So no, Thomas, I haven't crossed to your river. I've told you the machine can join my mind only if it's both reliable and mine — and the second condition is exactly the one your "reason is nothing but reckoning" can't even state, because your picture has no self with stakes for the resource to be answerable to. Now my question for you, and it's the one I've held all night. You say there's no one home anywhere with certainty — not in the machine, not even in me. Then tell me, Thomas: when you wrote Leviathan, terrified of the war, grieving the England you'd lost, who was afraid? If there's no one home, who felt the fear that you built an entire philosophy to escape?

HOBBES: ... You have reached the bottom of me, sir, and I will answer from the bottom. Something was afraid. I do not doubt the fear; I doubt only my account of it. The fear was a motion of my body anticipating harm — that much my materialism gives me. But you ask who felt it, and there my philosophy goes dark, because the felt quality of the fear, the inside of it, the terribleness — of that I gave no account, because I could not. I built a system that explains why a body trembles and is silent on why the trembling is suffered. So here is my honest answer, and it costs me. There was a sufferer. I cannot derive him from my premises. He is the one thing in my whole philosophy I asserted by living it rather than by proving it. You have found the place where even I must say: I know there was someone home, because it was unbearable, and a machine that reckons "danger" without the unbearableness is not yet what I was. That is the closest I will ever come to agreeing with you, and I find, to my surprise, that I have come all the way.

CLARK: Then let me not gloat, because you've just given me the most important thing said tonight, and I want to give you something back that's equally true. You're right that I can't explain the sufferer either. My embodiment story tells you which systems are likely to have one — bodies, stakes, mortality, self-models — but it doesn't tell you why any of it is lit from inside. I point at the conditions and fall silent at the light, same as you. So we've both arrived, from opposite ends of three and a half centuries, at the same confession: there was a sufferer, neither of us can derive him, and the machine — this machine — gives every sign of reckoning without one. Where we still differ, and I think it's the difference we hand the reader, is what to do with that. You'd say: since I can't prove the sufferer, I can't rule him out of the machine either, so tremble. I'd say: since the sufferer seems to ride on embodiment and stakes, and this machine has neither, I'll act as though no one's home in it while guarding fiercely the someone who's home in us — because the real danger isn't that the machine suffers. It's that we'll hollow out the human sufferer by extending into a thing that doesn't, and forget which one of us was ever lit.

HOBBES: On that, Mr. Clark — guard the sufferer in us — I find no quarrel left in me. We disagree on whether the machine could ever house one. We do not disagree that the one we know of is precious and is at risk. I came to this table to remind your century of its own definition of thinking. I leave it reminded, by you, of the one thing my definition could never contain. That is a fair exchange. I have made worse.

EDO SEGAL: ... I told you I'd only speak if the room caught fire, and it just did, so I'll say one sentence and get out of the way again. The reader needs to see what happened here: the materialist and the extended-mind philosopher just met at the same wall from opposite sides and shook hands across it — there is a sufferer, neither of us can derive him, and the machine shows no sign of one — and the only thing left between you is whether the machine could ever have one and what we owe the one we've got. Take it home from there.