Mary Shelley vs Fei Fei Li on AI · Ch9. The Apprentice and the Candle ← Ch8 Ch10 →
Txt Low Med High
HOUR TWO — THE CANDLE AND THE BODY
Chapter 9

The Apprentice and the Candle

Page 1 · The Apprentice and the

**EDO SEGAL:** This round begins with a twelve-year-old. In the spring of 2026 a girl asked her mother — and the mother asked me, at a dinner table, with the look parents get now — "Mom, what am I *for*?" Not what should I be when I grow up. What am I *for*. She had watched a machine do her homework better than she could, write a story better than she could, and she was lying awake doing the arithmetic children do honestly and adults do in euphemisms. I have spent two years answering her in my own way — I tell parents the [candle](https://www.youonai.ai/fieldguide/med/candle_in_the_darkness) is the asking itself, that the machine is an engine of answers and the child is an engine of questions. Tonight I get to stress-test my consolation against both of you, and I want to come at it through the classroom, because that is where the question lives now. Mary, your creature educated itself — alone, through a wall, by struggle. So you first. What does the machine in the classroom do to a child's formation?

· · ·
Page 2 · The Apprentice and the

**SHELLEY:** It threatens the one thing that made my creature a mind at all, which was that it had to *struggle* into being one. Watch how the creature learns in my book, because I built it as the opposite of frictionless. It hides for months in a hovel beside a cottage, watching a poor family through a chink in the wall, absorbing their language and their affections by slow, effortful attention. It teaches itself to read. It sits with not-knowing for so long that the knowing, when it comes, is *earned* and therefore *load-bearing*. The struggle was not an obstacle to the creature's education. The struggle *was* the education. And here is my fear for the child in your classroom: the machine answers before the question has finished forming. It removes the sitting-with-not-knowing, which is the exact experience in which the capacity to ask is built. You tell the mother her daughter is for the questions. I agree. But the capacity to ask is *built*, not issued, and it is built precisely in the friction your tools are designed to dissolve. Hand a child a thing that answers before she has finished being puzzled, and you have not freed her for higher things. You have paved the ground where the higher things grow.

**EDO SEGAL:** Fei-Fei — she has just turned the candle against me. She is saying my consolation, *she is for the questions*, is hollow if the machine removes the struggle in which the questioning is forged. You have spent your career on how children learn. Defend the machine in the classroom, or concede it.

**LI:** I will do neither cleanly, because the honest answer is split, and I have watched both halves with my own eyes. Mary is right — I will say it plainly — that struggle builds the asking-muscle and that a tool which removes all friction can atrophy the very capacity it claims to serve. I have spent my life on how a child comes to understand, and understanding is not the transfer of answers; it is the slow construction of a model of the world through effortful, embodied experience. So her warning is not wrong. It is, in fact, *my* warning, in a different vocabulary.

· · ·
Page 3 · The Apprentice and the

But here is the floor under it, and it is a floor Mary's view cannot see from where she stands. The child who *had* the patient tutor, the dinner-table adult, the teacher with time — for that child, yes, protect the struggle, keep the friction in the curriculum, do not let the machine answer too soon. But that child is rare. For hundreds of millions of children, the alternative to the tireless machine tutor was never a Socratic mentor. It was a bored class of forty and a workbook, or it was nothing at all. I was, myself, a child whose whole future turned on a few adults who took her strange questions seriously — and most children never get those adults. The machine takes every child's questions seriously, at three in the morning, in Lagos and in Chengdu, in a language she actually speaks, explaining the fourth time without sighing. Mary will say: it does not *take them seriously*, it generates the *shape* of taking-seriously. And my honest reply is that for the child on the receiving end, I am no longer certain that distinction carries the weight the warning needs. The understanding either gets built or it does not. The candle does not check the credentials of whatever lit it. So the variable, Mary, is not the machine. It is *deployment* — whether we build it to remove the struggle or to scaffold it, whether the rich district gets teachers-plus-tools and the discipline to keep friction in, while the poor district gets the chatbot and a headline about access. That two-tier outcome is the real danger, and it is a choice, not a property of the clay.

· · ·
Page 4 · The Apprentice and the

**SHELLEY:** It matters *enormously* what lit the candle, Fei-Fei, and your own example proves it against you. The adults who took your questions seriously did something the machine structurally cannot: they were *accountable* to you, over years. They watched what their explanations did to you and adjusted. They knew when to *refuse* you an answer because the struggle was the point. They modeled what it looks like for a *person* to think — which is the thing a child is actually learning when she is taught, far more than the content. That is what formation is. Not information transfer. Enculturation by an accountable mind. And here I return to the whole spine of my objection, because it converges here. I am the daughter of a woman who argued that an impoverished education produces an apparent inferiority that is then mistaken for nature. Give the poor child the answer-machine and the rich child the accountable human, and you will have manufactured exactly that — a generation taught by a thing that cannot be answerable to them, and then told the resulting gap is their own deficiency. The faces missing from your data, Fei-Fei, will become the minds malformed by your tutor. The pattern is the same. It is always the same. The careless formation, falling hardest on those with the least.

**LI:** *[a pause]* That is a serious charge and parts of it are landing where I cannot fully parry them. The two-tier risk is real and I have named it myself. But Mary, do not let the perfect accountable mentor — which most children never had — become the standard by which you condemn the imperfect tutor that reaches the child the mentor never would. You are comparing the machine to the tutor the rich child gets. I am comparing it to the *nothing* the poor child got. And on that comparison, the machine is not the thief of formation. It is, deployed with the discipline I keep insisting on, the first chance at formation a vast number of children have ever had.

· · ·
Page 5 · The Apprentice and the

**EDO SEGAL:** Let me bring the twelve-year-old back into the room and close this round through her, because both of you have now handed her mother something true and I want to hand it to her plainly. Mary's gift: protect the struggle — the boredom, the friction, the sitting-with-not-knowing — because the asking-muscle only grows under load, and the machine is a load-removing device. Fei-Fei's gift: the same machine, aimed well, is the first time in history every child can pull on the thread of any question as far as her curiosity runs, with no adult shortage to stop her. Here is what I would add, father to mother, and it is the answer to "what am I for." The answer was never going to come from the teacher or the tool. It comes from being the kind of creature that asks the question at all. Her question *is* the credential. And our job — parents, schools, and the people building these systems — is to make sure nothing in her world answers it for her so smoothly that she stops asking. Hold that. Because the next round leaves the mind for the body, and it is where Fei-Fei has bet her whole future, and where Mary's creature — who had a body, and a world that pushed back — has been waiting two hundred years for company. After this.

· · ·
Continue · Chapter 10
The Body and the World
← Prev 0%
Ch9 Next →