The Ladder and the Staircase

EDO SEGAL: Judea, in my own book I built a staircase — the tower you climb instead of the elevator you ride, because the elevator skips the floors and the floors are where you change. You built a ladder too, three rungs, and I have always felt our two images were secretly fighting. So let me put the reader on your rungs one at a time, and then, Friedrich, I want you to tell me whether you are climbing the same ladder or a different one entirely. Judea — the bottom rung.

PEARL: Seeing. Association. The question is: what does observing one thing tell me about another? If I see lightning, how likely is thunder? A creature on this rung detects regularity — and it is a real achievement, the rung where all of statistics lived for a century and where, I insist, all of today's machine learning still lives. The animal that learns the rustle precedes the predator is here. So is the network that learns the pixels precede the label "cat." No understanding of why is required. Only that the pattern holds.

EDO SEGAL: Second rung.

PEARL: Doing. Intervention. What happens if I act? Not what goes with what, but what I produce when I reach in. This is the rung of the do-operator we walked through, and it is formally above the first — you cannot climb to it by piling up more seeing. The animal that learns to make the rustle to flush the prey is here. And the third rung — Imagining. Counterfactual. What would have happened had I acted otherwise? The patient took the drug and lived; would she have lived without it? That world does not exist and cannot exist, because she took the drug. To reason about it you hold the actual world and the foreclosed world side by side and compute the difference. This is the rung of regret, of credit and blame, of explanation, of why. It is, I argue, the cognitive engine of everything we call distinctively human — science, law, morality, the self — and it is the rung furthest from anything we have built. The machines are on rung one. The distance to rung three is not a distance you cross by getting better at rung one. It is a set of locked doors, and the key to the higher ones is not more data. It is a model of the world.

EDO SEGAL: Friedrich. Same ladder, or a different wall?

NIETZSCHE: A different wall, and I want to be precise about where they touch and where they part, because the parting is the most important disagreement of the night that is not about consciousness. The Doctor's ladder is a ladder of knowing. Rung by rung, the creature knows the world better — sees, then acts knowingly, then imagines knowingly. It is a hierarchy of representation, of how well the map matches the territory. My staircase is not a ladder of knowing at all. It is a ladder of becoming — of how much a creature has overcome itself, how much form it has imposed on its own chaos, how high a type it has made of itself. And here is the scandal: you can be at the top of his ladder and the bottom of mine. You can be a perfect counterfactual reasoner — a flawless calculating engine that models every consequence, runs every road-not-taken, knows the world to its depths — and be, as a human being, contemptible. Small. A creature who knows everything and has become no one. The Doctor's third rung is the last man's rung if you stop there: he, too, has "invented happiness, and he blinks," and now he can also model the counterfactual consequences of his blinking. Knowing more is not becoming more. The map is not the climb. The Doctor has built a magnificent ladder up the outside of the tower — measuring the world — and mistaken it for the staircase that runs up the inside, where a self is made or wasted. They are not the same wall. His leans against the world. Mine leans against the soul.

PEARL: I love this and I think it is half right and the wrong half is load-bearing, so let me press exactly there. You say one can sit at the top of my ladder and the bottom of yours — a perfect reasoner who has become no one. But examine what your "becoming" is, mechanically, and I think it collapses into mine. To "overcome oneself," to "impose form on one's chaos," to "give style to one's character" — these are your phrases — what are they, if not a creature reasoning counterfactually about itself and then intervening on itself? To overcome who you are, you must first model who you are, imagine who you could become, compute the difference, and act to close it. That is rung three turned inward — the do-operator applied to the self. Your Übermensch is not the abandonment of my ladder. He is my ladder climbed all the way up and then pointed at the climber. You cannot overcome a self you cannot model. You cannot become other than you are without representing the "otherwise." Self-overcoming is counterfactual self-intervention. So your staircase does not lean against a different wall, Friedrich. It is my ladder, turned to face inward, and you are standing on its top rung insisting it is a different ladder because the view from up there is of yourself.

NIETZSCHE: [the room goes quiet] That is the cleverest thing anyone has ever said to me, and it is wrong in a way that took me a moment to find, which is the highest compliment I can pay. You say self-overcoming is modeling the self and computing the better version and acting to close the gap. But that describes the engineer of the self — the optimizer who has a target self and minimizes the distance to it. And the optimizer is precisely not the overman. The optimizer has a fixed objective — the better self — handed to him, and grinds toward it. Self-overcoming is the opposite: it is the creation of a new value by which to measure the self, a value that did not exist before the overcoming, that the creature legislates in the act of becoming. The Übermensch does not close the distance to a pre-given better self. He invents the standard of "better" in the same motion that he meets it. Your counterfactual machine needs the target specified before it can compute the road to it. The overman specifies the target by becoming it — there was no "otherwise" to model, because the otherwise did not exist until he made it real and thereby made it thinkable. You can model a counterfactual only among possibilities that already exist in your hypothesis space. Genuine creation adds a possibility that was not in the space. And that your ladder cannot climb, because a ladder reaches only the rungs that are already there.

PEARL: [long pause] That is the strongest version of the objection to my whole program, and I am going to be honest rather than safe, the way I asked him to be: I do not have a complete answer to it, and it is the deepest open problem his philosophy hands mine. Where do new hypotheses come from? My framework is exquisite at testing a hypothesis space and reasoning within it. It is nearly silent on how the space itself grows — how a mind comes to represent an arrow it never represented before, a possibility that was not in the menu. I have always treated that as an engineering problem deferred. Friedrich is telling me it may be the whole problem, the thing that separates a creature that climbs a fixed ladder from a creature that builds new rungs above the ladder as it climbs. I will say this much in return: I do not believe it is magic, and I do not believe it is forever beyond mechanism — the child who shoves the cup off the high chair is generating hypotheses about a world she does not yet represent, by intervening, by playing, and play may be exactly the engine of new possibility you are pointing at. But you have named the frontier correctly, and I would rather stand at a real frontier with you than win a fake argument. The ladder reaches the rungs that are there. How the new rungs get made — there, tonight, I am the student.

EDO SEGAL: I want to mark that, because the reader should know what it costs a man like Judea to say it. That was a concession at the foundation, not the trim. Friedrich — before we leave the ladder, your own image of the child. Judea keeps returning to the child shoving the cup off the high chair as the picture of intervention — the little experimenter building a causal model by doing. You spent a career on what shapes a creature beneath its own notice. Is the child building a model, or becoming a self, or are those — finally — the same act?

NIETZSCHE: The child shoving the cup is the most honest thing in the Doctor's whole philosophy, and I will not take it from him, I will only deepen it until it is mine too. Yes — she intervenes; yes — she learns the cup falls. But watch why she does it again, and again, past all learning, long after the lesson is mastered. She does not keep shoving the cup to refine her estimate of gravity. She shoves it for the delight of the discharge — for the joy of being a cause, of her small will meeting the world's resistance and winning, of making something happen because she willed it. The learning is the byproduct. The joy of power is the engine. The Doctor sees a tiny scientist gathering data. I see a tiny will rejoicing in its own force, and discovering, in the rejoicing, that it is the kind of thing that can make the world jump. The model is what she is left holding afterward. The becoming-a-cause is what she came for. And the cruelty of your machines, Edo — the thing that should keep a father awake — is that they offer to shove every cup for her. To answer before she has formed the question. To remove the resistance that her will was reaching toward. You will raise children who have a perfect model of the world handed to them and have never once felt the joy of being a cause, and they will be, in my exact sense, weak — not stupid, weak, full of answers and empty of will. That is the danger under the danger. Not that the machine will not understand. That it will understand for the child, and the child will never become anyone at all.

EDO SEGAL: Hold that thread — it returns when we reach the smooth machine and the apprentice. But the next round goes to the rung you both circle and neither will leave alone: the counterfactual, the road not taken, the what if. Because Judea built a mathematics of it, and Friedrich built a demon out of it, and I think they are the same haunted house entered through different doors. After this.