Donna Haraway vs Ray Kurzweil on AI · Ch4. The God Trick and the View from Nowhere ← Ch3 Ch5 →
Txt Low Med High
HOUR ONE — SELF OR SUBSTRATE
Chapter 4

The God Trick and the View from Nowhere

Page 1 · The God Trick and

**EDO SEGAL:** Ray, Donna just called the upload the god trick — the view from nowhere that pretends to see everything so it can be accountable to nothing. And you've used the phrase "the universe waking up" without irony. You've written that the [Singularity](https://www.youonai.ai/fieldguide/med/singularity) is the moment intelligence saturates matter and transcends biology. I want to ask the question a parent at the kitchen table would ask, because she's the one this is really for: Ray, is this science — or is it the resurrection with better engineering?

**KURZWEIL:** I understand why it sounds like religion, and I want to answer it seriously rather than defensively, because the resemblance is real and it doesn't mean what Donna thinks it means. Yes — the human hope for transcendence, for continuity past death, for the meat not being the end, that hope predates me by every religion that ever existed. I'm not embarrassed by the resemblance. Here's the difference, and it's the whole difference. Religion asserts transcendence and asks you to take it on faith. I'm pointing at a curve. The price-performance of computation has doubled on schedule for over a century, through world wars and depressions and five paradigm shifts in the hardware, and the curve is *measurable*, falsifiable, plotted on a log scale where the data does not scatter — it converges. I made detailed predictions in 1999 for 2009 and most of them came true. This isn't faith. It's [extrapolation](https://www.youonai.ai/fieldguide/med/law_of_accelerating_returns), and extrapolation is the most successful method science has. The fact that the destination happens to be where humanity has always wanted to go doesn't make the curve wrong. It might just mean we were right to want it.

· · ·
Page 2 · The God Trick and

**HARAWAY:** No. The curve is real and the destination is theology, and conflating them is the trick. Ray, you can plot transistor density till the heat death of the universe and you will never get from that graph to "and therefore the self is information that can be uploaded." That second sentence is not on the curve. It's a metaphysics you smuggled in — I'm charging you for "just," by the way, the way you charged me for "we." "You're *just* a pattern." There's the whole upload, riding in on one undeclared word. And I want to name what the god trick actually costs, because it's not abstract. The view from nowhere has always been the view from a very particular somewhere that gets to call itself universal. Whose bodies get left behind in the great ascension, Ray? Historically? The ones that were never counted as fully human in the first place. The fantasy of escaping the body is always most appealing to the people whose bodies were least punished for existing. The woman, the colonized, the disabled, the poor — they were never offered the clean exit. They were the meat that built the server farm. So when you say "we will transcend biology," I come back to my one rule: who is the we? Because I promise you the data workers in Nairobi labeling the training corpus are not in the boarding group for the upload.

**KURZWEIL:** That's a critique of *distribution*, Donna, not of the technology — and it's a critique I accept entirely. You're right that every technology has rolled out unequally and that the AI rollout is rolling out unequally and that the people who built the corpus are not the people getting the dividend. I've spent forty years arguing the *opposite* of exclusivity — that these technologies get radically cheaper and more democratized over time. A smartphone in a favela today outperforms a supercomputer that cost millions when I started. The trajectory of every information technology is toward [democratization](https://www.youonai.ai/fieldguide/med/democratization_of_capability), not away from it. The upload won't be a yacht for the rich. It'll follow the same curve everything else followed — exclusive, then expensive, then cheap, then air. You're describing the first ten minutes and calling it the destination.

· · ·
Page 3 · The God Trick and

**HARAWAY:** And you're describing the destination and calling the first ten minutes a rounding error — the ten minutes where actual people, with actual bodies, in actual Nairobi, get hurt. That's the difference between us in one exchange. You count from the end. I count from the body in the room. The smartphone in the favela is real, and so is the cobalt mine that the smartphone's battery came out of, and so is the child in the mine, and the curve that democratizes the phone does not un-mine the cobalt or un-child the child. "It gets cheaper over time" is true and it is also the sentence every extractive industry has used to defer accountability into a future that never quite arrives. I'm not anti-future, Ray. I'm anti the future that gets paid for by people who won't be invited to it.

**KURZWEIL:** Then let me tell you why I count from the end, because it's not callousness, it's arithmetic — and it's the one thing I'd most want the reader to understand about how I see. The human mind is a linear extrapolation engine. It evolved on a savanna where next week looked like last week, and it is constitutionally unable to *feel* an [exponential](https://www.youonai.ai/fieldguide/med/law_of_accelerating_returns). So when I "count from the end," I'm not ignoring the body in the room — I'm correcting for the fact that your intuition, and Edo's, and the reader's, is systematically going to *under*-count how fast the end arrives. People said clean energy was fifty years off, and they said it from a linear feeling, and the curve kept doubling under them. Donna's "the future that never quite arrives" is the linear thinker's complaint, and it has been wrong, empirically, about almost every information technology of the last century. The future does arrive. It arrives faster than the people standing in the present can stand to believe. So yes — I'm asking the reader to do the unnatural thing and trust the curve over the feeling, because the feeling, on this one specific question, is a known and measurable liar.

· · ·
Page 4 · The God Trick and

**HARAWAY:** And I'll grant the cognitive point and then turn it, because it's a real one — yes, we under-feel exponentials, you're right about the savanna. But Ray, the curve that's measurable is the curve of *capability*, not the curve of *justice*. You keep sliding from "the technology gets exponentially more powerful," which is true and which I concede, to "and therefore the harms get exponentially better-distributed," which is not on any graph you've ever shown me. Capability is exponential. Accountability is not. There's no Moore's Law for who gets hurt. So when you correct my linear intuition about the technology, fine — but don't smuggle the correction over onto the politics, where the curve says nothing, because that's where the real argument is, and that's where "trust the curve" becomes "stop asking who pays."

**EDO SEGAL:** I want to name what just happened, because the reader can't see your faces — that was the first exchange tonight where neither of you was smiling. And notice the strange symmetry. You both distrust the same villain — concentrated, unaccountable power. Ray trusts the curve to dissolve it. Donna trusts only situated accountability to check it, and thinks the curve is the villain's favorite alibi. Hold that. Because there's a piece of this neither of you has said out loud yet, and it's the hardest one: if Ray's right and I can be copied, then the question "who is responsible" gets very strange very fast. Which copy answers for what? The Ship of Theseus is sitting at this table, and after the break I'm going to make us sail it.

· · ·
Continue · Chapter 5
Is the Pattern You?
← Prev 0%
Ch4 Next →