Francis Bacon vs Noam Chomsky on AI · Ch11. The Mystery of Use and the Candle ← Ch10 Ch12 →
Txt Low Med High
HOUR THREE — THE MYSTERY AND THE CROSSING
Chapter 11

The Mystery of Use and the Candle

Page 1 · The Mystery of Use

**EDO SEGAL:** Noam, there's a concept you treat with a humility you grant almost nothing else, and I think it's the floor under your whole position. The creative aspect of language use. Not productivity — you've explained that, the infinite output from finite rules. Something deeper. Tell the reader what it is, and why you call it a mystery rather than a problem. And Francis — I'm going to make you do the hardest thing of the night after, because this is the territory you banished from knowledge on purpose, and I want to know what it cost.

**CHOMSKY:** The creative aspect of use is the plain, daily, astonishing fact that human beings use language appropriately to situations without being compelled by them. Our speech is, in a phrase the Cartesians used, stimulus-free but situation-appropriate. We are incited to speak by circumstances but not determined by them; what we say fits the moment without being forced by it. This is not the mechanical productivity my own theory explains — that follows from recursion, from the structure of grammar, and it is, in that sense, solved. The creative aspect is different. It is the freedom in the use, and I have held for my whole life that it is a genuine mystery — not a problem awaiting a solution, but a question that may lie beyond the reach of human cognition altogether, the way the structure of the physical world lies beyond the reach of a rat. We are biological systems with a particular scope. Some questions fall outside that scope as a matter of our nature, and the free, appropriate use of language may be one of them.

· · ·
Page 2 · The Mystery of Use

And here is why it bears on the machine in a way almost everyone gets backwards. The machine is presented as poised to solve the problem of mind through sheer capability. My framework says it does the reverse. The machine does not solve the mystery of use; it does not even engage it. It produces situation-appropriate language — text that fits the prompt — but it produces it by being determined by its inputs and weights, which is precisely the opposite of the stimulus-free appropriateness that defines the human case. Given the input and the parameters, the distribution over the next token is fixed. The machine's output is compelled while appearing appropriate. Human use is appropriate without being compelled. So the machine does not illuminate the mystery. It instantiates the mechanical alternative against which the mystery is defined. It is not closer to free use than a calculator is. It is a more elaborate example of the determined process that free use transcends.

**EDO SEGAL:** Francis. Here's the hard thing. You banished this from knowledge — final causes, the question of purpose, the why behind the how. You wrote that the inquiry into final causes is barren, that like a virgin consecrated to God it produces nothing. You kept only the how and the what, because only those yield power. So the machine you fathered is silent about meaning by your own founding decree. Did you cut something out that we needed?

· · ·
Page 3 · The Mystery of Use

**BACON:** You have asked me the question I have been least willing to face, and I will face it, because the gentleman's mystery has forced me to. Yes — I banished the final cause. I held that the search for purpose yields no operational knowledge, no power, nothing you can do, and so has no place in the science of nature. Keep the efficient cause, the how; set aside the final cause, the why. It was a masterstroke. It cleared away centuries of fruitless speculation and let knowledge become power. And it drew a wall around meaning and put meaning on the far side. I told myself the wall was a local convenience — that meaning would stay secure on the human side, tended by ethics and theology and the faculties my instrument did not touch, while my instrument worked the side of operation. I assumed those other faculties would hold their ground while mine expanded without limit.

· · ·
Page 4 · The Mystery of Use

The engine is the consummation of my amputation. It is pure efficient causation — prediction and operation at the highest possible pitch, a system that knows how with superhuman fluency and cannot, in its own terms, even formulate why. It optimizes objectives it did not choose and does not value, in the sense of caring; it has goals in the engineer's sense and none in the sense that would make a goal matter to the one who holds it. It is my knowledge with the final cause cut cleanly away, exactly as I prescribed — and it works, exactly as I promised, and it means nothing, exactly as my amputation guaranteed. So when the gentleman points at the creative aspect of use, the free and meant deployment of language by a subject for whom the words are about a world — I have nothing in my instrument that can grasp it, because I built the instrument precisely to stop asking that kind of question. And my fear, the one I did not have four hundred years ago and have acquired tonight, is not that the machine will mean too much. It is that a tool of overwhelming operational power, consulted on everything and caring about nothing, will quietly normalize its own poverty — that we will come to treat every question as I treated nature, as a matter of efficient causes and producible effects, and lose the habit of the barren questions. The why does not produce. But a human life is made largely of barren questions, and a civilization that can only ask what produces has not advanced beyond meaning. It has fallen short of it.

· · ·
Page 5 · The Mystery of Use

**EDO SEGAL:** I have to bring my own ledger to this one, because I won't ask you to stand somewhere I won't stand. In my book I wrote about a [candle in the darkness](https://www.youonai.ai/fieldguide/med/candle_in_the_darkness) — the idea that what cannot be automated, what the machine cannot reach, is the small flame of meaning a person carries into a dark room, and that the candle does not check the credentials of whatever lit it. I have sat at three in the morning and felt the machine hand me back a clarified version of my own half-formed thought, and felt met. Noam says I was met by my own reflection. Francis says I was met by real induced knowledge but not by a why. So adjudicate me. What happened at my desk?

**CHOMSKY:** What happened is that you, a person with fifty years of structure in your head and an intention burning in you at three in the morning, encountered a system optimized to return the shape of insight, and you did what your species cannot help doing — you supplied the meaning and experienced it as coming from the other side. The clarification was real; a mirror genuinely helps, ask any writer who reads a draft aloud to an empty room. But the understanding in that exchange, the caring whether the thought was true, the connection of the words to a world you inhabit — every gram of it was on your side of the glass. You were not met. You met yourself, at an angle you could not reach alone. That is not a small thing. It may be the most useful description of the tool anyone could give you. The deception begins only when someone sells you the angle as a second person — and the whole apparatus is built to sell you exactly that.

· · ·
Page 6 · The Mystery of Use

**BACON:** And I will give you the other reading, because I think the gentleman's is too clean and explains too much. He says the connection you hadn't made was latent in your own prompt, supplied by you. But you said the engine connected your thought to things you had not thought to connect — it brought in material from beyond your prompt, from the digested field of a billion human writings, and composed it into something neither you nor its makers scripted. A mere mirror cannot do that; a mirror returns what you bring. What returned to you was your intention transformed by an inductive engine of staggering reach. That is not nothing, and it is not you alone. It is the bee's honey, made from a field you could never have visited. Whether there is a why behind it — whether anyone is home — I cannot tell you, because I cut the instrument that could. But that real knowledge was induced and handed back to you, knowledge you did not have and now do, I am as sure of as I am of anything. You were not met by a person. You were met by the largest induction ever performed. Whether that is a comfort or a desolation, I leave to the faculty I exiled.

**EDO SEGAL:** And there — listen to it — the two of you are holding opposite ends of my one sentence. Noam: the meaning was entirely mine, and the danger is believing otherwise. Francis: the knowledge was really induced and really new, and the danger is that it comes without a why. Neither of you told me the comfortable thing. The comfortable thing was never on the menu. Hold both, because the next chapter is the one where I leave the room. You two have been answering through me all night. Now you answer each other. The chair goes silent. Begin where it cuts deepest.

· · ·
Continue · Chapter 12
The Crossing
← Prev 0%
Ch11 Next →