The Data or the Order

**EDO SEGAL:** Fei-Fei, you have a sentence that is as compressed and as consequential as Ada's, and it is the hinge of your whole career: the bottleneck was never the model, it was the data. Most people hear that as an engineering tip. I think it is a metaphysics. Take me back to the moment you knew it — not the paper, the moment — and tell me what you understood about minds, not just about machines.

**LI:** The moment was a child. Not a metaphor — an actual child, and the cognitive science about children, which I had been reading while my colleagues were tuning algorithms. A toddler shown a single cat will thereafter know cats — in shadow, from behind, drawn as cartoons — with an ease that humiliated every system we had. And the field's answer was always: the child has a better algorithm, we must find it. I came to believe that was exactly backwards. The child does not have a better algorithm. The child has been standing under a [waterfall of visual data](https://www.youonai.ai/fieldguide/med/river_of_intelligence) since the moment its eyes opened — every waking second, a torrent of images labeled implicitly by a world that pushes back. By the age of three the child has seen more visual examples than any dataset that then existed. What I understood, and it did change how I think about minds, is that the richness we call intelligence may be far less about the cleverness of the machinery and far more about the sheer abundance of the world that flowed through it. We had been starving our algorithms and blaming them for being thin.

**EDO SEGAL:** So restate it for me at the existential register, because this is where it stops being about vision. You are saying — literally — that what we call a mind might be mostly a record of how much world has passed through it. That the cleverage is not in the genius of the knower but in the volume of the known. Is that the version you find most compelling, or the one you most fear?

**LI:** Both, which is why it is the true one. I find it compelling because it is what the evidence showed — feed the ordinary network enough world and the structure of seeing assembles itself, no genius required. I fear it because of exactly what Ada will do with it in about four seconds. If a mind is mostly the world that passed through it, then the human author Ada is defending starts to look less like an origin and more like a *confluence* — a place where a great deal of world happened to gather and settle into a shape. And I do not actually want to live in a universe where origination is a comforting story we tell about confluences. But I have to follow the evidence even when it dissolves the floor under me. That is the price of the position I envied her for not having to pay.

*LOVELACE:** I will not do what you predicted, because you have armed me too well to need the cheap move. Yes — I agree that the world flowed into the child, and into your network, and that volume matters more than my century imagined. But notice the asymmetry you stepped past, because it is the entire estate. The world that flows into a child flows in *through a body that acts and is acted upon.* The child does not merely receive the cat as a labeled image. The child reaches for the cat, and the cat moves; the child is scratched, and learns that this softness has consequences; the child is hungry, and the world either feeds it or does not. The data the child drinks is *disciplined by stakes* — it is not a torrent of images, it is a torrent of images joined to a body that wants, fails, is hurt, persists. Your network drank the *pictures* of the world stripped of the wanting. It received the wake of a billion human engagements with cats and never once wanted anything from a cat. So when you say "the bottleneck was the data," I answer: the bottleneck was never *data*. It was *data with skin in it*. Your machine has the wake. The child has the boat, because the child is *in the water.

**LI:** This is the strongest thing you have said, and I am not going to wave it away, because the embodiment point is real and it is precisely the frontier I spent my second career on — robots, agents, systems that learn from a world that pushes back, which I did not pursue by accident. But watch what your own argument concedes. You say the network has the wake and the child has the boat *because the child is in the water with stakes.* Fine. Then the disagreement between us is no longer "machines cannot originate." It has become "machines cannot originate *yet, while they are denied a body and stakes.*" That is a wildly different claim, Ada. The first is a wall around machines as such. The second is a fence around the current generation, and fences move. The moment you locate the missing ingredient in embodiment and stakes rather than in some essential lack — you have agreed it is an empirical, engineering question whether the wall is a wall or a frontier. And I will take that bet. I have spent twenty years watching that fence move every spring.

**LOVELACE:** I have not conceded as much as you think, and here is the limit of the bet. Suppose you give your engine a body, and stakes, and let it want. You will have built something I would have to look at very hard, and I might lose my line against it — I am honest enough to say so. But you will not have done it by scaling the *order*. You will have done it by giving the machine a *self that the order serves* — a thing for which outcomes are good or bad, which is not more computation, it is a different category. My quarrel was never with how much world flows in. It was with the claim that volume of world, by itself, with no one for whom the world matters, adds up to a someone. You can flood the loom with every thread in France and you will get a more elaborate cloth. You will not get a weaver. The weaver is not made of thread.

**EDO SEGAL:** Before I let that thread go, I have to seat someone at this table who has been hovering all night, because he is the third party to your whole disagreement and neither of you has named him: Charles Babbage. Ada, you understood his engine better than he did — you saw it could act on music and language while he, who had every gear in his head, saw a calculator. So here is the question that joins your two centuries. Babbage built the loom and could not see what it meant. Fei-Fei built the network and *could* see, but cannot read how it sees. Is that the same blindness, a hundred and thirty years apart — the builder who cannot read his own creation?

**LOVELACE:** It is not the same blindness, and the difference is the most hopeful thing I can offer the reader tonight. Babbage's blindness was a failure of *imagination* — the engine was fully legible, every card traceable, and he simply did not lift his eyes from the arithmetic to the meaning. His blindness was curable by poetical science; I cured it, from outside, with no gears in my hands. Fei-Fei's blindness is different in kind. The network is *not* fully legible — she cannot trace the cards because the cards wrote themselves in a space too large to read. Babbage could have seen and didn't. Fei-Fei would see and *can't.* And that is the line your century crossed that mine did not: you built engines whose workings exceed the sight of the people who build them. My engine kept no secrets from a sufficiently poetic mind. Yours keeps secrets from everyone. That is new, and I will not pretend my century prepared anyone for it.

**LI:** And I want to sit inside that, because Ada has just described the thing that actually keeps me awake, more than any question of whether the machine is a mind. Babbage's engine I could have audited. Mine I cannot. When my network denies someone a loan, or flags a tumor, or steers a car, it is making the decision in the unreadable space where the cards wrote themselves — and there is no poetical science that lets me lift my eyes and *see* the reason, because the reason is distributed across a structure that resists being read by anyone, including me, including the machine. So the human-centered part of my whole project is not a slogan. It is a response to exactly the blindness Ada named: if we cannot read the loom, then the human must stay in the loop not as a sentimental gesture but as the *only legible thing in the system* — the one place where a reason can be asked for and given. The machine out-finds us into a darkness none of us can read. The candle is not just the meaning. The candle is the only light by which the finding can be *accounted for* to the people it lands on.

**EDO SEGAL:** Hold that — "the weaver is not made of thread" — because it returns in the round on the candle, the thing neither of you thinks can be automated. But you have just handed the reader the cleanest version of the fork: Ada says volume of world without a self that stakes care about is elaboration, not origination. Fei-Fei says the self and the stakes are an engineering frontier, not a metaphysical wall, and the fence keeps moving. Next round we go to the word that has been crouching under this whole conversation — *emergence* — and I want to know whether it names a real new thing or just the moment our expectations were beaten.