Donna Haraway vs Ray Kurzweil on AI · Ch5. Is the Pattern You? ← Ch4 Ch6 →
Txt Low Med High
HOUR ONE — SELF OR SUBSTRATE
Chapter 5

Is the Pattern You?

Page 1 · Is the Pattern You?
Staying With The Trouble
Staying With The Trouble

EDO SEGAL: Ray, I'm going to take you absolutely literally, because that's how you force precision. Tonight, at this table, we scan you — every neuron, every connection, perfect fidelity — and we instantiate the pattern on a substrate in the next room. Now there are two. The one in the next room has all your memories, believes it is Ray Kurzweil, loves your wife, remembers writing The Age of Spiritual Machines. And the one across from me is still here, still breathing, still mortal. So I ask the original — you — the simple question: are you now safe from death? Because if the answer is no, the upload didn't save you. It made a very convincing stranger and then let you die anyway.

You're right that the destructive copy scenario — scan and instantiate while the original persists — produces two, and the original is not thereby rescued from mortality.

KURZWEIL: This is the best version of the objection and I'm not going to dodge it. You're right that the destructive copy scenario — scan and instantiate while the original persists — produces two, and the original is not thereby rescued from mortality. I concede that completely. But that's not how I think the merger actually goes, and the difference is everything. The merger is gradual. You don't scan-and-jump. You add non-biological capacity to the biological brain a little at a time — the way I add a search engine to my memory today, the way someone adds a cochlear implant or a neural interface tomorrow. The non-biological fraction grows; the biological fraction shrinks; but there is never a moment of discontinuity, never a copy made beside you, never a stranger. It's the same gradual substitution your atoms already do. By the time you're mostly non-biological, you got there by a continuous path, the way you got from being a child to being who you are now without ever dying in between. No teleporter. No stranger. Just the slow tide.

EDO SEGAL: So the move is — gradual, never a copy, the substrate changes under continuous selfhood, the way it already does. Donna, that's a much harder target than the scanner. He's not claiming to beam himself anywhere. He's claiming the tide does it and you never notice the water change.

· · ·
Page 2 · Is the Pattern You?

HARAWAY: It's a harder target and it has the same hole, just buried deeper. Ray, the gradual story works only if "adding non-biological capacity" and "becoming a different substrate" are the same kind of operation — and they're not. Adding a search engine to your memory keeps the body as the seat that does the adding, the one that gets to decide, that bears the consequence, that wakes up as the continuous animal. Your continuity, even in the gradual story, runs through the surviving biological thread. The day the last of the biological thread is gone — and you have to cross that day, gradual or not — what's left is running on a substrate that was never the bearer of your accountability, only the recipient of your pattern. You can make the staircase have a million steps instead of one leap. There is still a top step where the body is no longer there. And at that top step the same question stands, and you have only moved it, not answered it: is the thing at the top you, situated and answerable, or a perfect performance of you with no one home to take the call?

KURZWEIL: But you're assuming the body is doing some special accountability-work that silicon can't do, and you haven't said what that work is, only that the body does it. I'll make the symmetric demand: name the mechanism. What does the meat do, in virtue of being meat, that the same pattern on a faster substrate cannot do? If you can't name it, then "the body is the seat of accountability" is just the chauvinism of carbon — the same move people made for "only humans have souls," "only men can reason," every line we've drawn to keep someone out. You taught me to be suspicious of those lines, Donna. I'm turning your own knife around.

· · ·
Page 3 · Is the Pattern You?

HARAWAY: And it's a good turn, and here's the mechanism, because I can name it. The body is mortal and bounded and singular — there is exactly one of it, it is somewhere, and it will end. Those aren't bugs. They are the entire infrastructure of being answerable. Accountability requires a who that can be found, held, and lost. Your uploaded pattern can be copied — you just admitted the copy scenario is coherent even if you avoid it — which means it is in principle plural, and a plural self is an unaccountable self, because when there are a thousand of you, which one owes the debt? It can be rolled back, edited, restored from backup — which means it cannot truly suffer a consequence, because any consequence can be undone. It can be everywhere — which means it is answerable nowhere. Mortality, singularity, locatedness: that's the mechanism. The body keeps you findable. The upload's whole promise is to stop being findable, and a self that cannot be found cannot be held, and a self that cannot be held is not free — it's feral. I don't want us feral. I want us kin.

· · ·
Page 4 · Is the Pattern You?

KURZWEIL: This is the most serious version of the objection and I want to answer the strongest part, which is plurality, because the rollback and the everywhere I can handle, but plurality I have to earn. You're right that an information-self can in principle fork, and you're right that a thousand of me raises a real and unsolved question about who owes the debt. But notice that this is a governance problem, not a metaphysics problem — and we solve governance problems all the time without invoking the sanctity of meat. Corporations are plural, distributed, copyable bundles of agency, and we built law to hold them answerable — imperfectly, but really. A forkable self would need the same: rules about which instance carries the liabilities, which inherits the debts, what consent a fork requires. Hard, yes. But "hard to govern" is not "impossible to be," and the body's solution to the accountability problem — there's only one of you, so we always know who to blame — is not a deep truth about selfhood. It's just the crude version that worked when we had no other tools. We can build better accountability than scarcity. We've done it before.

HARAWAY: Corporations — Ray, you've just handed me my closing argument and I don't think you meant to. Yes, we made the law to hold the plural, distributed, copyable agent accountable, and how is that going? The corporation is the closest thing we have to your uploaded self — deathless, forkable, everywhere and nowhere, a pattern of agency cut loose from any single mortal body — and it is the most successfully unaccountable entity our civilization has ever produced. It externalizes its harms, outlives its crimes, reincorporates in a friendlier jurisdiction when the bill comes due. That's not a reassuring precedent. That's the warning. You're proposing to do to the self what we already did to the firm, and the firm is the thing eating the planet precisely because we severed agency from a findable, mortal, losable body. So no — "we governed the corporation" is not the comfort you think it is. It's exhibit A for why I want us to stay singular and stay mortal and stay in reach of the people we can hurt.

· · ·
Page 5 · Is the Pattern You?

KURZWEIL: That's a devastating example and I'm not going to pretend it isn't — you took my own analogy and turned it into the prosecution. Let me say what's true in it and where I still stand. True: the corporation is a partial preview of an unaccountable distributed agent, and it's a warning, and I should have seen you'd take it there. Where I stand: the corporation is unaccountable not because it's deathless and distributed, but because we designed its accountability badly — we let it externalize, we let it reincorporate, we built the law in the interest of the thing being governed. That's a failure of will and design, not a proof that distributed agents can't be held. We could have built corporate law with teeth. We chose not to, because the people writing it owned the corporations. So your example tells me the danger is real and the stakes are political — which I grant — but it doesn't tell me it's impossible, only that we've done it badly once. I'd rather learn from the bad version than conclude the body is the only jail that works.

HARAWAY: And I'd say "we designed it badly" is the most dangerous sentence in your whole optimism, Ray, because it's always available. Every unaccountable power, after the fact, was a design we could have done better — and we never do, because the same severance that makes the agent powerful makes it powerful enough to write its own rules. That's not a coincidence you can engineer around. It's the structure. The body holds you accountable whether or not the powerful consent to it, because nobody had to pass a law to make you mortal. That's the genius of it. Your better-designed accountability requires the cooperation of exactly the entities it's meant to constrain. Mortality requires no one's cooperation. That's why I'll keep it.

· · ·
Page 6 · Is the Pattern You?

EDO SEGAL: That's the strongest thing said at this table so far, and I want to sit in it for one beat before we climb. Donna has just claimed that death is not the enemy of the self — it's the condition of the self being real, findable, accountable. Ray has spent fifty years calling death the enemy, full stop. You are now, both of you, exactly as far apart as two serious people can be, and you got there honestly. Hold the thread — singularity and mortality, the findable self. We pick it up in the round on what cannot be copied at all. But next: the body Donna keeps invoking isn't a metaphor. It's a thing that mines cobalt and labels data and sits in a chair until it hurts. We go to the bodies, after this.

· · ·
Continue · Chapter 6
The Bodies in the Server
← Prev 0%
Ch5 Next →