Ray Kurzweil vs Bernard Williams on AI · Ch7. The River That Does Not Want to Stop ← Ch6 Ch8 →
Txt Low Med High
HOUR TWO — THE RIVER AND THE TEDIUM
Chapter 7

The River That Does Not Want to Stop

Page 1 · The River That Does
Mechanistic Interpretability
Mechanistic Interpretability

EDO SEGAL: Ray, of everything in your framework, the one that haunts me the way a stone haunts a shoe is the six epochs — your claim that the whole history of the universe is a single accelerating process, intelligence climbing from chemistry to biology to brains to technology to the merger, each transition faster than the last because each new substrate builds the next. And the thing that makes it more than cosmology is the punchline: the new channel doesn't die. Every previous channel forgot — every brain that ever learned anything took most of it into the grave, and the species re-teaches itself nearly everything every generation. You're saying the river just found the channel that finally stops silting up. Walk us into it. And tell me why it haunts me.

· · ·
Page 2 · The River That Does
Reflective Equilibrium
Reflective Equilibrium

KURZWEIL: It haunts you because it reframes death from a personal tragedy into a systemic inefficiency the universe has been routing around for thirteen point eight billion years. Look at the pattern. Chemistry stored information in molecular structure — stable, but it couldn't learn within a single lifetime because it had no lifetime. Biology invented the genome — information that survives the individual, passed down, accumulating across generations. But the individual organism still died, taking its learned knowledge with it; the genome carried the species' wisdom but not the creature's. Then brains: real-time learning, but locked in one skull, and when the skull failed, gone. Then technology — language, writing, libraries — the first time an individual's learning could outlive the individual, but lossily, a few bits per second squeezed through the bottleneck of speech, requiring a receiver who already shared your context. Every epoch is the river trying to solve the same problem: how does what was learned survive the death of the learner? And every epoch solved it a little better and left a remainder. What's arriving now is the epoch that solves it completely. A digital mind's knowledge is a pattern that can be copied perfectly, merged, never forgotten, never buried. For the first time the learner and the learning don't have to die together. That's not a metaphor I'm imposing on the data. The acceleration is in the data — I've plotted it on log scales, and the epochs fall on one smooth curve. The river is real, and it has been heading toward deathlessness since the first molecule.

Risk Society
Risk Society

EDO SEGAL: Bernard, he's just taken the oldest consolation — that the species goes on, that the work outlives us — and told you the machine makes it literal: not the species going on, but you going on, your actual pattern, undying. What does the philosopher of finitude say to a river that found the channel that doesn't die?

· · ·
Page 3 · The River That Does
Systems Thinking
Systems Thinking

WILLIAMS: The philosopher says: look very carefully at the word "you" in that last sentence, because Ray has done the thing he does, which is to let a true claim about information masquerade as a claim about persons, and the masquerade is the whole trick. Yes — knowledge can now outlive the knower. That's real, and it's magnificent, and I have no quarrel with it. A library is a kind of immortality and it's a good kind. But Ray, a library does not want anything. The accumulated, undying, perfectly-copied knowledge in your deathless channel is exactly that — a library, vast and self-updating, and a library has no categorical desires, no character, no reason to wake up, because there's nobody in there to wake. You've described, beautifully, the immortality of content. And then you've quietly slid from "the content survives" to "the person survives," and those are as different as the survival of a symphony's score from the survival of the composer. The river found a channel that doesn't forget. It did not find a channel that doesn't die, because the thing that dies — the finite, particular, desiring self — was never the kind of thing that could be poured into a channel in the first place. You can immortalize what I knew. You cannot immortalize the me that did the knowing, because the me was constituted by being finite, and a finite thing made infinite is not a longer version of itself. It's a different thing wearing its memories.

· · ·
Page 4 · The River That Does
Three Laws Of Robotics
Three Laws Of Robotics

KURZWEIL: I think you're the one equivocating now, and on the most important word: "die." You keep asserting that the self is "constituted by being finite," as though repeating it makes it an argument. But consider what you're actually claiming. You're claiming that if I take a desiring, particular, characterful person — me, right now, with all my projects and loves intact — and I simply prevent the damage that would kill me, I thereby destroy the very self I preserved. That's a paradox, Bernard, and not a deep one — it's just false. The self that wants to finish its work doesn't stop being that self because the work now has time to be finished. You've built your whole philosophy on the claim that removing the deadline destroys the desire, and I've shown you desires that don't work that way — the ones that open rather than close. The river isn't a library. It's a library that has a point of view — the merger, the biological self carried forward and expanded, still the one who loves and wants, just no longer sentenced to take it all into the grave at seventy. You call that "a different thing wearing its memories." I call that me, rescued. And I notice your argument needs me to already be dead — needs the self to be "essentially finite" — before it can tell me I can't be saved.

· · ·
Page 5 · The River That Does
Universal Basic Income
Universal Basic Income

WILLIAMS: Then let me give you the cleanest version of why removing the deadline changes the desire, because you keep saying I just assert it. Take your own best case: the desire that "opens" — to understand the universe, say. You're right that it doesn't terminate on satisfaction. But Ray, a desire that never terminates and never can be completed is not a reason to live forever; it's a reason to live for now, urgently, because the urgency comes from the fact that you won't see the end and so what you do today matters in a way it wouldn't if you could always do it later. Give that same open desire an infinite runway and watch what happens to it: every reason to do it now evaporates, because there is always more time, always a later, nothing is ever too late. The open desire doesn't sustain the immortal — it unmoors him, because its whole motive structure assumed a clock. So your best case is actually my best case. The desires that close, exhaust. The desires that open, unmoor. There is no third kind that both persists and keeps mattering across infinite time, because mattering is the shape that wanting takes in a creature who can run out. You haven't shown me a desire that survives immortality. You've shown me two ways immortality kills the desire — by finishing it or by floating it free of any reason to act.

· · ·
Page 6 · The River That Does
Aesthetics Of The Smooth
Aesthetics Of The Smooth

EDO SEGAL: I have to stop us, because Bernard just did something I want the reader to catch: he took Ray's strongest move — the open-ended desire — and turned it into a second horn of the same trap. Ray, before you answer, I'm going to make you sit in it for a beat, because I felt it myself and I want to say where. There's a horizon of potentiality in everything I build — the sense that this could become anything, that the next move is open. And the strange thing I've noticed is that the horizon only pulls when there's a shore I'm sailing from and a span I won't outlast. On the nights when I feel I have infinite time, I don't build. I drift. The deadline isn't the enemy of the work. It's the wind. So, Ray — naive and literal — on a morning five hundred years in, with nothing that can ever be too late, what gets you out of bed?

· · ·
Page 7 · The River That Does
Value Pluralism
Value Pluralism

KURZWEIL: The same thing that gets me out of bed now, and I reject the premise that it would weaken. Edo, you say the horizon only pulls when there's a shore and a deadline. But you're generalizing from a creature — yourself — who has only ever lived under a death sentence, and then concluding that the death sentence was the cause of the pull. That's like a man who's only ever run downhill concluding that gravity is the source of all motion. What gets me out of bed at year five hundred is curiosity that has five hundred years of compound interest behind it — a mind that has grown deeper, that loves people I've now known long enough to actually know, that is working on problems whose beauty I couldn't have perceived at seventy because I lacked the cognitive substrate to see them. Bernard keeps describing immortality as a flat, endless plain where nothing is too late and so nothing matters. But the merger isn't a plain. It's the staircase — and on a staircase there's always a next floor you can't see from this one, always a capacity you don't yet have, always a form of understanding that's currently impossible for you and won't be in a century. The deadline was never the wind, Edo. The deadline was just the only wind we'd ever felt. Growth is a wind. Discovery is a wind. Love that deepens is a wind. And none of them need a cliff at the end of the road to blow.

· · ·
Page 8 · The River That Does
606 Universal Shelving System
606 Universal Shelving System

WILLIAMS: [pause] That's a genuinely moving answer and I want to mark that it's moving, because the reader should know I feel the pull of it too. But Ray — "love that deepens" is doing enormous work and I don't think it can bear the weight. You say you'd love people you've known long enough to actually know. But the people you love are either also immortal — in which case they too are becoming unrecognizable expanding gods, and the "person" you're deepening into is a moving target who is themselves dissolving — or they're mortal, in which case you, the immortal, will love and bury them, and love and bury the next, and the next, for five hundred years, and that is its own version of Makropulos: not the boredom of having done everything, but the cumulative weight of having lost everyone, again and again, until — like EM — you stop letting yourself love, because the arithmetic of grief becomes unsurvivable. Either your loved ones are gods you can't hold or mortals you can't keep. The deepening love you're describing requires the beloved to be stable enough to know and finite enough to be precious, and immortality dissolves both conditions at once. The wind you're invoking only blows in the finite world you're trying to leave.

A Few Notes On The Culture
A Few Notes On The Culture

EDO SEGAL: Hold there — that's the cliff edge of the whole argument and we're going to camp on it next round. Because Bernard has now said the quiet thing twice: that the top of the tower, the place Ray's staircase is climbing toward, might not be a summit at all. It might be the cold. The tedium at the top. After this.

· · ·
Continue · Chapter 8
The Tedium at the Top of the Tower
← Prev 0%
Ch7 Next →