CONCEPT
Wordsmiths in the Dark
Fei-Fei Li's characterization of large language models as eloquent but ungrounded—systems that have ingested enormous quantities of human text and can recombine it with startling facility, but that have never perceived a physical world or closed the perception-action loop that living creatures use to ground meaning.
The phrase is Fei-Fei Li's and its sharpness comes from precision, not provocation. A wordsmith is a maker of language, someone with genuine skill over the medium; in the dark means without the embodied experience of a world to which the words refer.
Large language models are, by Li's analysis, exactly this: extraordinarily capable at the surface of language—at producing, recombining, and completing text in ways that match or exceed human fluency—while fundamentally lacking the experiential grounding that gives language its connection to reality in living creatures. A child learning the word "staircase" learns it alongside the falls, the effort of climbing, the proprioceptive memory of where the next step is; she learns it in a world that pushes back. A language model learns the word from its co-occurrences with other words in text: it knows everything that has been written about staircases and cannot, from that knowledge alone,