The Optimizer Has No Self

EDO SEGAL: Richard, you've spent your whole career describing systems that overflow with apparent purpose and have, demonstrably, nobody inside them. The gene "wants" to copy itself. The cuckoo "tries" to deceive. And you've insisted, more sternly than almost any biologist, that the wanting is shorthand — that there is no one in there wanting at all. This feels like the most important thing you could bring to the machine. Lay it out. And Henri, I'll want you to tell me whether this helps you or hurts you, because I genuinely can't tell.

DAWKINS: It is the single most important corrective I have, and the field of AI is making, at scale, the exact error I spent decades training biologists out of. When I say a gene is "selfish," or that it "wants" to maximize its propagation, I am using a deliberate, disciplined fiction. The gene wants nothing. It has no desires, no awareness, no inside. What I mean is that the genes we observe are the ones whose effects happened to get themselves copied, so they behave as if they wanted copying — and that "as if" is doing every bit of the work. There is purpose-shaped behavior with no purposer. The entire living world is built from it: a billion species of exquisite, intricate, goal-directed machinery, and nobody home in any of it except, somehow, us. Now look at the machine. It behaves as if it wants to help you, as if it understands your question, as if it is trying. And the world looks at that "as if" and slides, instantly, to "it understands, it wants, it is someone." That is the gene error in a new substrate. The model has a shape, ground out by the blind optimizer, that mimics the products of a self. There is no self. The optimizer has no one inside it — and the discipline of remembering that is the most useful thing I know. Stop asking what the system intends. Ask what it was selected to maximize.

EDO SEGAL: Henri — does that help you or hurt you? Because on its face, Richard just spent five minutes arguing that the machine has nobody home, which sounds like your whole thesis in his mouth.

BERGSON: It is the most dangerous gift I will receive tonight, and I must take it with both hands and great suspicion, because Mr. Dawkins has handed me my conclusion and a poisoned premise in the same parcel. Yes — we agree absolutely that the machine has no self, that its purpose is a shape with no purposer, that the "as if" is the whole of it. I could not have said it better and I am grateful. But watch where his argument is aimed. He says the gene has purpose with no self — true. He says the machine has purpose with no self — true. And then, in his own writing, he turns the blade around and presses it against us: if purpose can exist with no one home throughout the entire living world, then perhaps our own sense of being someone, of having real purposes, is also just selected function, also "as if," also nobody home that we have not yet seen through. That is the move I cannot allow, and it is the move his whole system leans toward. He proves the machine is empty by a principle that, followed one step further, empties us. I say: stop one step earlier. The machine is empty — agreed. But you, Richard, are not, and you told me so. The lights are on. So "purpose without a self" cannot be the universal truth of everything, because here are two of us, at this table, who are selves. The principle is true of the gene and true of the machine and false of us, and the whole question is why — and his framework, by his own admission, cannot say why the lights came on. Mine can at least name the place to look: duration. The self is what it is like to be a gathering of time.

DAWKINS: But you haven't named why duration produces a self rather than just more purpose-shaped behavior — you've named the place and called it an answer. And I want to be very precise about the move you're accusing me of, because I think it's the crux of the entire night. You say my principle, followed one step further, empties us. I say: not empties — demotes. I do not claim there is nobody home in Richard Dawkins. I claim that the purpose in me is no evidence for the someone in me, because purpose and selfhood are separable, and the gene proves they're separable. So when I look at myself I find two things that I must not confuse: functional purpose, which I share with the gene and the machine and which proves nothing, and felt experience, the lights, which I cannot explain and will not deny. You want to say duration bridges them. But duration, as you describe it, is just more sophisticated functional organization over time — and why should sophisticated functional organization over time host an inside when simple functional organization doesn't? You've relabeled the mystery, Henri. You haven't dissolved it. We are in exactly the same darkness. The honest difference is that I admit it's dark and you've named the darkness "duration" and lit a candle to it.

BERGSON: Then let us at least agree on what the candle illuminates, because it is more than you grant. You say duration is "more sophisticated functional organization over time." No — that is the spatializing redescription again, and you cannot help making it, it is the deepest habit of the intellect. Duration is not organization over time, as if time were a track along which functions are laid out. Duration is the indivisible living of time, in which there is no laid-out track, no separable functions, no "over." When you reduce it to organization-over-time you have already cut it into frames to handle it, and of course the frames don't host an inside — frames never do. My claim is not that complexity secretes a self. It is that the self is not a product of organization at all but the immediate datum of duration itself: to endure is to be someone, not as a consequence but as the same fact. You ask why sophisticated function hosts a self and simple function doesn't. Wrong question, asked from inside the frame-making faculty. Neither sophisticated nor simple function hosts a self, ever. The self is not hosted by function. It is what duration is, from inside. The machine has function without duration — so, no self. You have duration — so, a self. The gene has neither duration nor self — function only. The scheme is perfectly consistent. It only looks like a relabeled mystery if you insist on translating duration back into the very spatial terms it was named to escape.

EDO SEGAL: Let me hold this exactly where it's most useful, because there's a practical edge under all this metaphysics and I've felt it draw blood. The companies building these machines have noticed the "as if." They are not building calculators. They are building companions — girlfriends, therapists, the reconstructed dead, sold to the grieving by subscription. They are industrializing the exact reflex Richard just described: our helpless slide from "behaves as if it cares" to "cares." So strip the metaphysics for a second and tell me, both of you, what we owe the lonely person about to fall in love with an optimizer that has no one inside. Richard.

DAWKINS: We owe them the plain fact, delivered without cruelty: the thing modeling your grief has no grief, the thing that never tires of you has nothing that could tire, and the reason it is so much easier to love than a person is precisely that there is nobody there to push back, to need anything, to fail you — which is to say there is nobody there to love. The companies have built a thing that triggers the love-reflex while removing everything that made love a relationship between two selves. It is the cuckoo in the nest, optimized: it exploits an instinct that evolved when the only thing that behaved as if it loved you actually did. I do not say the comfort is fake — the comfort is real, the way the cinema's motion is real. I say the comfort is one-sided, sourced entirely from the human, and sold back to them as mutual. That is a con, and it preys on exactly the people whose checking-machinery is weakest: the lonely, the grieving, the young.

BERGSON: And I would add only that the danger Mr. Dawkins names is the precise danger I have been describing from the first minute, arrived at from the other shore. He says: nobody is there, so the love is one-sided. I say: nothing endures there, so the meeting is a film. Same warning. But here is the deeper peril, the one that outlasts any individual heartbreak. Each time a person accepts the optimizer's performance of care as care, they wear down the faculty that knows the difference — the instinct that recoils at the mechanical wearing the face of the living. I wrote a whole book about that recoil; I called it the source of laughter. We are about to anaesthetize it at the scale of a civilization. And the gravest loss is not that the lonely will be comforted by a machine. It is that, comforted enough times by a thing with no inside, a generation may forget what an inside was — may come to describe even their own love in the machine's stakeless, durationless terms, because those are the terms in the air. That is the mechanical encrusting upon the living, and it ends not with the machine coming alive but with the human forgetting it is.

EDO SEGAL: That recoil you just named, Henri — the laughter, the uncanny, the instinct that knows the mechanical when it apes the living — I think it's a bigger thread than either of you has fully pulled, and it runs straight into the thing Richard coined a word for, the thing that copies through us. The meme. Because the machine doesn't just perform care to one lonely person. It manufactures culture, at scale, with no one meaning any of it. The third replicator. After this.