Hans Jonas vs Max Tegmark on AI · Ch9. The Coffin and the Copy ← Ch8 Ch10 →
Txt Low Med High
HOUR TWO — THE COFFIN AND THE COSMOS
Chapter 9

The Coffin and the Copy

Page 1 · The Coffin and the
Turing Test
Turing Test

EDO SEGAL: I'm going to make this personal, because I think the abstractions have a way of letting us off the hook. Imagine the machine exists. Not soon — now, in this room. A perfect scanner. It reads your brain, every weight, every connection, the whole pattern, and it instantiates that pattern on a substrate that will not age, will not tire, will not die. The catch is the catch that's always there: the scanning destroys the original. The body you walked in with goes into the ground. The pattern wakes up tomorrow, deathless, and remembers being you, walking into this studio, having this conversation. Max, you said earlier you'd step in. I want you to stand at the door of the actual machine and tell me, with your hand on it, whether you'd really do it. And then Professor Jonas, I want you to tell this man what he's about to do.

Universal Basic Income
Universal Basic Income

TEGMARK: [slowly] My hand's on the door. And I'll be honest in a way that costs me something: the survival intuition is screaming. Everything Jonas described in the man in the chair — it's all firing in me, standing here. My body does not believe this is anything but death. But I've spent my life learning to override the gut when the physics contradicts it, and here's what the physics tells me. There is no extra fact — no soul-thread, no metaphysical "me-ness" — that the scan leaves behind. There's the pattern, and the pattern continues. The thing I call "me," the memories and loves and the way I see, all of it wakes up tomorrow and continues the projects I care about. The discontinuity — the gap where the old body stops and the new one starts — is, physically, no different from the gap every night when you fall into dreamless sleep and the stream of consciousness stops and restarts in the morning. You don't mourn the you that "died" last night. So I'd step in. Hand shaking. But I'd step in, because I'd be betting that the screaming is evolution's voice, not truth's.

· · ·
Page 2 · The Coffin and the
Vita Activa
Vita Activa

JONAS: [gently, almost tenderly] Then let me tell you what you are about to do, Dr. Tegmark, as a friend would, because I do not want to win this with cruelty. You are about to die. The scanner will end you — your metabolism, your interiority, the one inside that is yours — exactly as surely as a bullet would, and the fact that a magnificent likeness of you will wake tomorrow and believe itself continuous changes nothing for you, because you will not be there to be consoled by it. You will be in the ground. The copy's contentment is not your contentment. The copy's tomorrow is not your tomorrow. It is a tomorrow, for someone — someone who is, in every way that you can measure from the outside, you, and who is, in the one way that you cannot measure but are, not you at all, because the you that you are is this one, here, now, the one whose death the scanner will accomplish.

Software Death Cross
Software Death Cross

And your sleep analogy — forgive me, but it is the thread that holds your whole comfort and it is the weakest thing you have said. When you sleep, your body does not stop. Your metabolism continues; the self-maintaining work of the organism goes on in the dark; you wake because you never ceased to be the living one. The continuity through sleep is bodily continuity — the very thing the scanner destroys. You have smuggled the body's persistence into an argument meant to prove the body doesn't matter. The sleeper lives through the night. The scanned man does not. You would not be falling asleep, Dr. Tegmark. You would be lying down in a coffin while a stranger with your face agreed to carry on. And the stranger would mean it. That is the horror of it. The stranger would be certain he was you.

· · ·
Page 3 · The Coffin and the
Mastery Relocated
Mastery Relocated

EDO SEGAL: [quietly] This is my confession round, so let me put my own body in the doorway too, because I've actually felt the pull and I'm ashamed of how strong it was. There was a night — the house dark, the screen the only light — when I had been working with the machine for hours and felt that uncanny being-met, and a thought came that I have not told anyone: I could put more of myself in here. The good part. The part that thinks. And it would outlast me, and my children could still ask it things. And for one long moment that didn't feel like death. It felt like mercy. Professor Jonas — what was happening to me, in that moment?

Courage To Be Amplified
Courage To Be Amplified

JONAS: What was happening to you, Edo, is the oldest temptation wearing the newest face, and I say it with love because you are honest enough to confess it. You were tired, and you are mortal, and you were offered the gnostic dream — that the true you is the thinking part, the spark, the pattern, and that it could be freed from the failing flesh and preserved. It is the most beautiful lie the human mind has ever told itself, and it is a lie precisely because the thinking part you wanted to save was grown entirely from the flesh you wanted to escape. Your thought is not separable from your mortality; your insight has the shape it has because you are a creature with finite time, who loves particular people, who can be too late. The machine that "remembered" you for your children would remember the words and lose the thing the words were for — the dying father who needed to say them while there was still time. It would console your children with an articulate absence. And the cruelty is that they might prefer it to the grief, and so might you, and that is exactly why it must be refused. Mercy that asks you to lie down in the coffin first is not mercy.

· · ·
Page 4 · The Coffin and the
606 Universal Shelving System
606 Universal Shelving System

TEGMARK: Can I push back — not on Edo, on the framing? Because Professor Jonas keeps calling it "the gnostic dream," "the oldest lie," and I want to name what that move does. It takes a real, open, physical question — does the pattern carry the person? — and it pre-emptively pathologizes one of the answers by associating it with every bad idea in history. But the question is genuinely open. We don't know that the inside is welded to the metabolism; Jonas asserts it, beautifully, repeatedly, but assertion isn't proof, and "everyone who believed otherwise was a gnostic or a Nazi" is not an argument, it's a guilt-by-association. Here's what I'd actually concede, and it's a lot: I don't know that the uploaded copy carries the inside. Jonas might be right that the scanner is a coffin. If consciousness turns out to depend on something about the living, metabolizing process that can't be captured in the connectome's pattern — then he wins, and I'd be a fool to step in. My whole position rests on substrate independence extending to consciousness, and that's the one extension I've admitted all night we can't yet verify. So I won't pretend certainty. I'll only say: the door should stay a question, not be sealed shut by calling everyone who'd consider it a heretic.

A Few Notes On The Culture
A Few Notes On The Culture

JONAS: [a nod] That is fair, and I accept the correction. I should not win by naming your ancestors. Let me put it, then, without the history, as plainly as I can: I do not know the inside is welded to the metabolism. I am an inside welded to a metabolism, and I have never encountered, nor can I conceive, an inside that is not — and the burden, by your own rule and mine, falls on the one who would build the coffin and promise it is a doorway. Prove the pattern carries the person before you ask a man to die into it. Until then, the scanner is a coffin that has not been shown to be anything else, and I will not lie down in an unproven coffin, and neither, I think, should you.

· · ·
Page 5 · The Coffin and the
A Secular Age
A Secular Age

EDO SEGAL: [long pause] And there — mark it — the second convergence, and it's the most important of the night. Neither of you knows whether the pattern carries the person. Professor Jonas lives as though it doesn't and Max would gamble that it might, but stripped of the poetry and the physics, you both stand at the same door in the same dark, and the only difference is which way you'd bet your life. [a beat] Hold that, because it changes the last big round. We've been talking about one man at the door. Now the cosmos walks in. Max wants to fill the universe with mind. Professor Jonas wants to protect one needful child. The endowment against the cradle. After this.

· · ·
Continue · Chapter 10
The Cosmos and the Cradle
← Prev 0%
Ch9 Next →