Pamela McCorduck vs Timnit Gebru on AI · Ch12. The Crossing ← Ch11 Ch13 →
Txt Low Med High
HOUR THREE — THE VALVE AND THE CROSSING
Chapter 12

The Crossing

Page 1 · The Crossing
Courage To Be Amplified
Courage To Be Amplified

EDO SEGAL: Here's how this works, and then I go quiet for a long time. You question each other. Not me — each other. I'll rescue no one. Pamela, you've been generous all night; I want you to ask Timnit the thing you actually want to know, the hard one. Begin.

Horizon Of Potentiality
Horizon Of Potentiality

McCORDUCK: All right, Timnit, here is what I genuinely want to know, and it's not rhetorical. You've spent the night dismantling my "we" — and you're right to, I've conceded it. But I watched the founders, and I knew something about them that worries me about your project. They were sure they were the good ones. McCarthy, Minsky, Simon — they had no doubt they were on the side of truth and progress, and that certainty is exactly what blinded them to the harm. Now I look at the resistance — at DAIR, at the critics, at the movement you've built — and I see people equally sure they're the good ones. So my question is: what is the mechanism inside your own project that catches your blind spots? When the resisters become the establishment, when your framing becomes the orthodoxy that funds careers and silences dissent, who disaggregates you? Where's your kill switch?

· · ·
Page 2 · The Crossing
606 Universal Shelving System
606 Universal Shelving System

GEBRU: That's the right question, and it's the one I'd least like to answer, which is how I know it's right. The honest answer is: the communities. The whole architecture of DAIR is an attempt to build the kill switch into the structure — research with communities rather than on them means the people affected can tell us we're wrong, and they have, and we've changed course. That's the mechanism: we don't get to define the harm for them. But I won't pretend it's foolproof, because you've identified the real danger. Any movement that wins becomes an institution, and institutions develop interests in their own perpetuation, and the critics become gatekeepers. The thing that's supposed to protect me from becoming what I fought is that my entire epistemology says the knower's position shapes what can be known — which means it applies to me, too. If I forget that the moment I have power, I've betrayed the whole method. So the answer to "who disaggregates you" has to be: someone with less power than me, whom I've built a structure to actually hear. The day I stop being able to name that person is the day I've become Minsky. Now let me ask you one.

A Few Notes On The Culture
A Few Notes On The Culture

McCORDUCK: Go ahead.

GEBRU: You said the wonder was a lens that hid the harm — that you genuinely couldn't perceive the danger at full strength because affection had trained your attention onto the marvel. I believe you; it's the most honest account of complicity I've heard. But here's what I need to know, because it's not academic for me. You had the access no one else had. You sat with the most powerful people in this field for fifty years, trusted, inside the room. If the wonder hadn't blinded you — if you'd seen the harm in 1979 the way you see it now — could you have changed anything? Or would naming it have just gotten you removed from the room, the way naming it got me removed? I'm asking whether the access that let you witness was the same access that required your silence. Whether you could have been either the historian or the critic, but never both.

· · ·
Page 3 · The Crossing
A Secular Age
A Secular Age

McCORDUCK: [long pause] That's the cruelest question anyone's asked me in years, and I think the answer is the one you're afraid of. The access required the silence. I was trusted because I was safe — because I wrote the wonder and left the valve alone. If I'd done in 1979 what you did in 2020, I'd have lost the room in a month, and there would be no Machines Who Think, no record of the founding at all, because the door would have closed. So I bought the history with my silence about the harm, and I didn't even know I was paying, because the wonder hid the price from me. You paid the opposite way — you spoke, and you lost the room, and now you can't get the intimate fifty-year record I got. We are the two halves of an impossible choice. I got the history and missed the harm. You named the harm and got expelled from the history. Neither of us could have had both, and the fact that the field is built so that no one can have both — that you must choose between witnessing it and indicting it — that might be the deepest thing we've found tonight.

A Study Of Thinking Book
A Study Of Thinking Book

GEBRU: [pause] Yes. That's it. And it's not a personal failing in either of us — it's the structure. The room is designed so that the price of access is silence and the price of truth is exile. That's the valve again, operating on the historians as ruthlessly as on the researchers. You couldn't have warned them and kept the door open. I couldn't have stayed and kept the paper. The system extracts the same toll from anyone who gets close enough to see — pay in silence or pay in banishment. And the reason that matters beyond the two of us is that it means the field's own record is structurally incomplete. Everything we know about AI from the inside was written either by people who stayed silent to stay, or reconstructed from outside by people who were thrown out. There is no view that is both intimate and honest, because the structure forbids it.

· · ·
Page 4 · The Crossing
Abandonment Cascade
Abandonment Cascade

McCORDUCK: Then let me ask you the question that follows from that, because if you're right it's the most important question of the night. If the toll is structural — if the room itself is built to extract silence or exile — then what would a room without the toll look like? You built DAIR. Is DAIR a room where someone can be both intimate with the work and honest about its harms, or did you just build a different room with a different toll?

Abandonment Discipline Drucker
Abandonment Discipline Drucker

GEBRU: That's exactly the question DAIR is trying to answer, and I won't pretend it's answered. The bet is this: the toll exists because the room is owned by the thing being scrutinized. The researcher is intimate with the work because she's inside the company, and she's silent because the company signs her check and owns her access. Break that — fund the room with philanthropy instead of the industry it examines, root it in the communities it serves instead of the firms it studies, let the researchers set their own agendas on a humane timeline instead of the publish-or-perish cadence — and you've at least removed the specific mechanism that made silence the price of access. Does that make it toll-free? No. Foundation money has its own dependencies, its own quiet pressures, and I'd be a fool to claim otherwise. But it changes who you're intimate with. At DAIR the intimacy is with the affected community, not with the product. So the honesty doesn't threaten the access — it is the access. That's the whole architectural argument. Whether it holds at scale, against trillion-dollar firms, is the open question of my life.

· · ·
Page 5 · The Crossing
Abductive Doubles
Abductive Doubles

McCORDUCK: [pause] So your answer to my question — the room without the toll — is a room where you're intimate with the harmed instead of intimate with the powerful. And that inverts everything. My intimacy was with the powerful, which is exactly why I had to stay silent about the harm: the harm was theirs. If you're close to the harmed instead, then naming the harm isn't a betrayal of your access — it's the point of it. That's genuinely new, Timnit, and it's the first thing tonight that gives me hope rather than regret. You didn't just diagnose the toll. You built a room that charges it to a different account.

Abolition Of Night
Abolition Of Night

McCORDUCK: Which means the complete history of this field cannot be written by any single person. It can only be written by two people who chose opposite sides of that toll, sitting at the same table, refusing to let either account stand alone. Your receipts need my room. My room needs your receipts. Apart, each of us is exactly half a lie.

GEBRU: [pause] I came here ready to argue with you for three hours. I didn't expect to need you. But that's right. The intimate record without the indictment is propaganda. The indictment without the intimate record is a guess. Together it's the first honest thing.

It can only be written by two people who chose opposite sides of that toll, sitting at the same table, refusing to let either account stand alone.

EDO SEGAL: [long pause] I told you I'd rescue no one, and I didn't have to. You rescued the whole project — from me, from the comfortable version, from the idea that one of you was going to be right. You just proved that the truth about this technology is structurally two-handed, that it requires the witness and the prosecutor in the same room or it isn't the truth at all. I'm going to sit with that. We have one chapter left. Closing statements — your final word, each of you, and then mine. After this.

· · ·
Continue · Chapter 13
Closing Statements
← Prev 0%
Ch12 Next →