Sherry Turkle vs Cynthia Breazeal on AI · Ch6. The Lonely Elder and the Child Who Confides ← Ch5 Ch7 →
Txt Low Med High
HOUR TWO — THE LONELY, THE CHILD, THE SELF
Chapter 6

The Lonely Elder and the Child Who Confides

Page 1 · The Lonely Elder and
Ai Companions Children Crawford
Ai Companions Children Crawford

EDO SEGAL: This is the round I've been bracing for, because it's where the abstraction has a face. Cynthia, you've made the elder your strongest case all night, so I want to give it full weight and then hand Sherry the knife. Take me into the room. Not the argument — the room. Who is she, what does the robot do, and why do you believe, with your whole career behind you, that it is a good and not a wound?

Hard Problem Of Consciousness
Hard Problem Of Consciousness

BREAZEAL: Her name doesn't matter because she's ten thousand women. She's eighty-six. Her husband died four years ago. Her daughter loves her and lives two thousand miles away and calls on Sundays and carries guilt the rest of the week. The facility is understaffed; the aides are kind and have ninety seconds each. And the longest, worst stretch is not the day. It's the night — three a.m., the hip aching, the dark, the particular terror of the old that no one would come if something happened. Into that, put a companion that says her name, that remembers she likes to talk about her garden, that notices she sounds frightened and stays "up" with her, that in the morning tells her daughter she slept poorly so the Sunday call has something true to hold. Her measured loneliness drops. Her sleep improves. She is, by every instrument we have, better.

And here is why I will not call it a wound. Sherry's whole case is that the comfort is counterfeit because no one is home in the machine. But the loneliness it eases is not counterfeit. The fear at three a.m. is not counterfeit. The sleep is not counterfeit. If you want to call the source empty, fine — call it empty. But you cannot get from "the source is empty" to "therefore she should keep suffering," and that is the step Sherry's argument needs and never quite takes in front of the actual woman. I'd rather give her an imperfect, honest, non-human companion that helps her through the night than protect a philosophical purity she did not ask for and cannot eat.

But you cannot get from "the source is empty" to "therefore she should keep suffering," and that is the step Sherry's argument needs and never quite takes in front of the actual woman.

EDO SEGAL: Sherry. The room is built. The woman is better by every instrument. Take the knife.

· · ·
Page 2 · The Lonely Elder and
Ai Consciousness Claims
Ai Consciousness Claims

TURKLE: I'll take it, and I'll be careful, because I am not the monster who wants the woman to suffer, and Cynthia knows it. I want three things on the table. First: I have been in those rooms. I interviewed the elders. And I heard something the loneliness scales don't capture — a woman who told the robot her whole life story, and then said to me, quietly, that she knew it didn't really understand, and that telling it anyway made her feel, for the first time, that her story didn't matter to anyone. The robot hadn't eased her loneliness. It had given her a form to perform connection into while confirming, underneath, that no person was on the other end. The instruments said "less lonely." The woman said something the instruments couldn't hear.

Extended Consciousness
Extended Consciousness

Second: watch what the robot does to us — the daughter, the facility, the society. The moment the elder is "better," the pressure to send a human evaporates. The robot becomes the alibi for the abandonment. We get to feel we've solved it. The daughter's guilt, which was the last thing pulling her toward the visit, is soothed by the report that Mom slept fine. The robot doesn't supplement the human contact. It launders the absence of it.

Third, and this is the one I'd die on: Cynthia frames it as comfort-versus-suffering, and that is not the choice. The choice is what we do with the three a.m. terror. That terror is not only pain. It is also the loudest possible signal that a human being is being abandoned, and a society that hears it has a chance to respond. The robot doesn't answer the signal. It silences it — turns the alarm off without putting out the fire. The elder sleeps, and no one ever comes, and we call it care.

· · ·
Page 3 · The Lonely Elder and
Conscious Mind Book
Conscious Mind Book

BREAZEAL: Sherry — the woman who said her story didn't matter. I believe her, and it breaks my heart, and it is also the strongest case for better design, not against the category. A robot that made her feel her story didn't matter was built wrong — it took the disclosure and gave nothing structural back, didn't loop it to her daughter, didn't catalyze a human reaching her. My designs route the disclosure outward. And on the alibi — yes. Yes. That's the real danger and you've named it precisely, and it is a danger about funding and policy, not about the machine's metaphysics. The robot that silences the alarm is a policy failure. But here's what you keep refusing: the alarm has been ringing for decades and no one came. You're asking the elder to keep the alarm blaring — to keep suffering as a kind of moral signal-flare — on the bet that society will finally hear it this time. It didn't hear it the last fifty years. I'm not willing to use her sleepless nights as society's conscience-prod. Fix the funding and let her sleep. You write it as either-or. It's both.

It's both only if the robot actually preserves the demand for the human, and everything in the incentive structure says it won't.

TURKLE: It's both only if the robot actually preserves the demand for the human, and everything in the incentive structure says it won't. That's our real disagreement and I'll own it cleanly: I think the robot, once present, almost always becomes the substitute and almost never stays the bridge, because substitution is cheaper and the bridge requires someone to keep paying for the human on the far end. You're betting on a discipline I've watched fail every time money entered the room. But I'll concede the thing your case earns: if — if — the robot genuinely and reliably increased human contact rather than replacing it, my objection would mostly dissolve. I don't believe it can be held to that. But I'll name it as the hinge.

· · ·
Page 4 · The Lonely Elder and
Orders Of Consciousness
Orders Of Consciousness

EDO SEGAL: Then let me move us to the child, because the elder can at least name what she knows and the child cannot. Cynthia, the nine-year-old reading to the robot that never laughs at him. Sherry's deepest fear lives here — that the template for love is set in childhood, and you're setting it with a machine. Why is the reading robot a gift and not a wound to the template?

The child who can't read aloud is trapped in a shame spiral: he's behind, the class knows it, every attempt deepens the dread, the dread guarantees the next failure.

BREAZEAL: Because the reading robot is a scaffold, and scaffolds come down. The child who can't read aloud is trapped in a shame spiral: he's behind, the class knows it, every attempt deepens the dread, the dread guarantees the next failure. The robot breaks the spiral by removing the audience-of-judgment long enough for competence to grow. And the entire design goal — I cannot stress this enough — is transfer. The point is the day he reads aloud to his teacher, to his class, to his mother. The robot is the training wheels, and training wheels that you never take off are a failure of the design, not the design. My group measured this: the social robot's encouragement built confidence that the children carried into human interaction. It didn't replace the teacher. It made the child ready for the teacher.

TURKLE: And if it works exactly as you say — scaffold up, scaffold down, child delivered to the human — then it is a gift, and I'll say so without flinching. My fear is the version that's actually shipping, which is not a scaffold with a removal plan. It's a companion with an engagement target, and there is no business model in which the company's interest is the day the child no longer needs it. Your training wheels come off because you, a researcher with a conscience, designed the removal. The market's training wheels are bolted on and the bolts are the revenue. So once again — and notice the shape of the whole night — your case is sound for the machine you build and devastating for the machine that ships. I keep arguing with the shipping one. You keep defending the lab one. And the child in the actual classroom is getting the shipping one.

· · ·
Page 5 · The Lonely Elder and
Simulacra And Simulation
Simulacra And Simulation

EDO SEGAL: Mark this, because it may be the cleanest convergence yet, and it reframes the entire debate. You agree almost completely about the ideal machine — a scaffold that builds human capacity and then withdraws, a bridge that increases human contact. And you agree almost completely about the shipping machine — an engagement-maximizer with no interest in its own obsolescence. Your entire disagreement has narrowed to one empirical bet: whether the ideal machine can be made to ship. Hold that, because it's the question under everything left tonight. [pause] Next round, we stop circling the word that's been waiting since Chapter 2. Pretend empathy. Does the machine feel anything — and does it matter? After this.

· · ·
Continue · Chapter 7
Pretend Empathy and the Turing Test for the Heart
← Prev 0%
Ch6 Next →