Margaret Boden vs Emily M Bender on AI · Ch2. Opening Positions ← Ch1 Ch3 →
Txt Low Med High
HOUR ONE — THE LINE ON THE SCREEN
Chapter 2

Opening Positions

Page 1 · Opening Positions
Bodens Taxonomy Three Creativities
Bodens Taxonomy Three Creativities

EDO SEGAL: Margaret, the floor is yours. Build the case from the foundation. Assume nothing.

Meaning As Use
Meaning As Use

BODEN: Very well. Let us begin by rescuing the word creativity from the people who love it most, because they have nearly smothered it. The romantic tradition holds that creativity is inexplicable — divine inspiration, the muse, the bolt from the blue. This is not a theory. It is a refusal to theorize, dressed as reverence. If creativity were truly inexplicable, we could not teach it, nurture it, recognize it, or distinguish more of it from less. We do all four, daily. Therefore it has structure. My career has been an attempt to say what the structure is.

Let me show you the fog at work before I clear it, because the fog has famous names. Coleridge claimed Kubla Khan arrived whole in an opium dream, interrupted by the person from Porlock — and scholars later found his working drafts. Mozart was said to compose entire symphonies in his head and merely transcribe them — on the evidence of a letter now known to be a forgery. The romantic tradition does not merely fail to explain creativity; it actively manufactures evidence against explanation, because the explanation threatens the social magic of genius. I begin here because tonight's debate inherits the manufacturing. When a company says its system dreamed up a molecule, and when a critic says the system merely shuffled its training data, both are running the Mozart forgery in different directions — both are protecting a story about where the magic lives instead of doing the analysis. I propose we do the analysis.

· · ·
Page 2 · Opening Positions
Intentionality Searle
Intentionality Searle

A creative idea, I have argued, is one that is new, surprising, and valuable. Each word is load-bearing. And the first thing the definition forces upon us is a distinction almost everyone skips: new to whom? An idea may be new to the person who has it though others have had it before — I call that psychological creativity, P-creativity. Or new in the whole of human history — historical creativity, H-creativity. The child who works out for herself that you can count on your fingers in two different orders and the total comes out the same has had a P-creative insight of real depth, though a billion children had it first. H-creativity is just P-creativity that happens to win the lottery of timing. The mechanism is in the P. This matters tonight because your lighthouse sentence, Edo, is trivially H-novel as a string — but H-novelty of strings is cheap. My washing machine produces H-novel vibration patterns. The question is whether the system that produced your sentence did something that, in a human, we would call having an idea.

Novelty Surprise Value
Novelty Surprise Value

EDO SEGAL: And your answer is yes.

BODEN: My answer is: it depends which of the three doors it came through, and that is not a hedge, it is the entire theory. Combinational creativity makes unfamiliar combinations of familiar ideas — the poet's metaphor, grief taught to swim. Exploratory creativity moves through an existing conceptual space — a style, a genre, a theory — and finds places in it no one had reached, the way a jazz musician finds a phrase the idiom always permitted but no one had played. And transformational creativity, the rarest and the crown, alters the space itself: drops a constraint, inverts a rule, and makes thinkable what was previously impossible — not unlikely, impossible — within the old space. Schoenberg dropping tonality. Kekulé letting the molecule be a ring. Each door, I contend, is a mechanism. And mechanisms do not care what they are made of.

My answer is: it depends which of the three doors it came through, and that is not a hedge, it is the entire theory.

EDO SEGAL: Emily. The floor is yours. Same rules.

· · ·
Page 3 · Opening Positions
Consciousness
Consciousness

BENDER: Thank you. I want to start by accepting almost all of that. The taxonomy is genuinely useful — I assign it. Creativity as new, surprising, valuable; the P and the H; the three doors. Fine machinery. Here is what I do not accept, and it is the hinge of my entire position: Margaret's machinery is a theory of idea-having systems, and she has quietly assumed that a language model is one. It is not. And the reason it is not has nothing to do with mysticism about silicon. It has to do with what language is.

Qualia
Qualia

Language is not the strings. Language is an activity between people — a joint game in which I have an intention, I model what you know, I choose forms I predict will reshape your mind in the way I intend, and you run the machinery backward: not what do these words associate with but what was she trying to do by saying them to me, now, here? Meaning lives in that loop. The text is the residue the loop leaves behind — the wake, not the boat. Now: train a system on nothing but wakes. Billions of wakes, every wake ever left. You will get a system superhuman at wake-shaped objects. Your lighthouse sentence is a wake-shaped object, Edo, and it is a lovely one. But there was no boat. No one taught grief to swim in that sentence, because teaching, grief, swimming, and the tenderness you felt all live on the meaning side of the line, and the system has only ever touched the form side. The beauty was real — and it was yours. You brought it, you found it, and the system's parameters arranged the occasion. I call that a mirror, not because mirrors are worthless, but because mistaking a mirror for a window changes what you do next — and at civilizational scale, what we all do next.

BODEN: May I mark, for the record, where the bodies are buried in that lovely speech? Emily has defined meaning as the human loop — defined it, not discovered it — and then declared the machine outside the loop by definition. I shall be digging at that grave all evening.

I call that a mirror, not because mirrors are worthless, but because mistaking a mirror for a window changes what you do next — and at civilizational scale, what we all do next.

BENDER: And I'll mark mine: Margaret said mechanisms don't care what they're made of. True. But they care enormously what they're connected to — and that, not the substrate, is my entire argument.

EDO SEGAL: Two graves marked, then. Let's start digging.

· · ·
Continue · Chapter 3
The Three Doors
← Prev 0%
Ch2 Next →