Henri Bergson vs Hans Moravec on AI · Ch12. The Crossing ← Ch11 Ch13 →
Txt Low Med High
HOUR THREE — THE FORKED SELF
Chapter 12

The Crossing

Page 1 · The Crossing
What We Owe The Future
What We Owe The Future

EDO SEGAL: No preamble. Henri, you start — ask Hans the thing you actually want to know, not the thing you want to defeat.

Civilizational Intelligence
Civilizational Intelligence

BERGSON: Then I will ask it without armor. Hans — on the day your wife is dying, and a machine offers you a scan of her, taken last week, that will speak in her voice and recall your shared life and respond as she would have responded — will you grieve? Or will you greet the scan as your wife continued? I am not asking what your theory permits. I am asking what you, Hans Moravec, will do in that room, because I think your body knows something your books deny.

MORAVEC: I'll grieve. Of course I'll grieve. And I've thought about why, because you're right that it cuts against the books. I think I'll grieve because the scan was taken last week — it stopped where the scan stopped, and the woman I'm losing kept living past it, kept changing, and those last days are not in the file. The scan is my wife minus the ending, and the ending is part of her. But Henri — notice what that admission is. I'm not grieving because the pattern can't be her. I'm grieving because this particular pattern is stale, incomplete, cut off before the end. Give me a scan taken at the last possible moment, continuous to the final breath, and my grief changes character — it becomes grief that she can't make new memories, not grief that she's gone. That's a real loss but it's a different loss, and it tells me the body's grief is tracking discontinuity and closure, not the absence of a soul. My grief is evidence for me, not for you.

· · ·
Page 2 · The Crossing
Future Of Life Institute
Future Of Life Institute

BERGSON: No. Your grief is tracking the absence of her, and you have just spent your honesty redescribing the absence as a missing week. Ask yourself the harder version: the scan taken at the last breath, complete, continuous — you said your grief would become grief that "she can't make new memories." But why would you grieve that, if the scan is her? You grieve it because you know, in the body you keep citing against me, that a being who cannot make genuinely new memories, who cannot be surprised and changed and undergo a future, is not living — it is replaying. You have admitted that the thing whose loss you grieve is precisely the openness, the duration, the capacity to undergo the new — the very thing I have said all night the pattern cannot hold. Your grief is my argument, Hans. You feel the truth your books step over.

Openai Departure
Openai Departure

MORAVEC: Then let me ask you something, Henri, because I've answered for my body and I'd like you to answer for yours. You say the scan can't be her because it can't undergo a new future. Fine. Now: a learning system, embodied, that does undergo a new future — that meets each day surprised, is changed by it, makes genuinely new memories, grapples with a resisting world that can kill it. By your own grief-criterion, just now, the thing missing from the scan was openness to the new, and I've just handed you a machine that has it. So tell me — and don't retreat to "but it's not alive," because that's the word we're trying to cash out — what, specifically, does that open, learning, embodied, mortal machine still lack that your dying wife has? Name it without using "duration" or "life," because those are the words on trial.

· · ·
Page 3 · The Crossing
Silicon Valley Ideology
Silicon Valley Ideology

BERGSON: You have asked the one fair question, and I will honor it by trying to answer without my safe words. What it lacks is this: a for-whom. When your machine is surprised, something in it changes — a weight, a state, a model. When my wife is surprised, the change is suffered by someone — there is [a point of view at which the surprise arrives](https://www.youonai.ai/fieldguide/med/qualia), a someone to whom the new is given, a sufferer of the undergoing. Your machine has the event of updating. It does not, as far as anything has ever shown, have the someone the event happens to. And I cannot point to that someone from the outside, in your machine or in my wife — that is the whole tragedy of my position, that the thing I am naming is invisible to every instrument including yours. But I know it exists in at least one case, my own, with a certainty that grounds everything, and I infer it in my wife because she is a life like mine, and I withhold it from your machine because it is not. You will say: that is just carbon prejudice with a sob in it. Perhaps. But you asked what it lacks, and the answer is: it lacks the one who would be lacking anything. There is updating, and there is no one updated. That is what I cannot find in it, and what I cannot stop finding in her.

· · ·
Page 4 · The Crossing
Machine Runs Away
Machine Runs Away

MORAVEC: That's the most honest thing you've said, and it's also — do you hear it? — an admission that your "for-whom" makes no difference anyone can detect, in your wife or in my machine. You infer it in her from kinship and deny it in mine from kinship, and the kinship is being made of the same stuff. Strip the sob away and your criterion is: same substance as me gets a for-whom, different substance doesn't. That's not a discovery about consciousness. That's the oldest boundary our species ever drew, and we've been wrong about where it goes every single time we've drawn it — around other tribes, other races, other animals. I think you're drawing it one last time, around carbon, and I think your great-grandchildren will find it as quaint as we find the others.

Not one of them was the discovery that there is no for-whom at all — that the center was always empty.

BERGSON: And I think, Hans, that you have confused the expansion of the circle with the dissolution of its center. Yes — we were wrong to exclude tribes, races, animals; we failed to recognize durations that were there. Every correction you cite was the discovery of a for-whom we had wrongly denied. Not one of them was the discovery that there is no for-whom at all — that the center was always empty. You are not expanding the circle of the living to include the machine. You are proposing that the circle never had a living center, that there was never anyone home in any of us, that "for-whom" was always a useful illusion. That is not the next moral progress. It is the abolition of the thing all the moral progress was about. You would free the machine into the circle of persons by quietly announcing that the circle was empty all along. I would sooner be called quaint.

· · ·
Page 5 · The Crossing
Ai As Alien Intelligence
Ai As Alien Intelligence

EDO SEGAL: I told you I'd stay out until one of you drew blood or drew together, and what just happened was both. You drew together on the fact — neither of you can point to the for-whom from outside. And you drew blood on what the fact means: Hans, that an undetectable thing is no thing; Henri, that the one undetectable thing is the only thing that was ever real. That's the bottom of the well. We don't go deeper than that tonight, because there isn't a deeper. We go to last words.

· · ·
Continue · Chapter 13
Closing Statements
← Prev 0%
Ch12 Next →