Closing Statements

EDO SEGAL: Three hours. We started with a question and we are not going to leave with an answer, which is the whole design. Before your closing statements, the bookend I ask in every one of these — and it's not rhetorical, it changes how I'll read your final words. Name the strongest thing the other person said tonight. Not the most agreeable — the one you'll still be arguing with next month. Professor Zuboff first.

ZUBOFF: The strongest thing Jeremy said — the one I'll be arguing with for the rest of my life — is the determinist's trap, and the way it survived even after I escaped it. He asked me to find the sovereign author the machine usurped, and warned that I was mourning a king who never reigned. I answered with the through-versus-around distinction, and I believe my answer. But he planted a doubt I can't fully dig out: that I keep speaking as if there were once a free, unauthored self that the machine stole, when every self was always shaped by something. I think I'm right that the new shaping is different in kind. But he made me see that I have to earn that difference every time, that I can't just invoke a pristine autonomy that never existed. He took my central concept and made me prove it from scratch. That's the strongest thing anyone has done to my work in years, and he did it in an evening, having been dead for most of it.

EDO SEGAL: Professor Bentham.

BENTHAM: The strongest thing my opponent said — the one that has cracked something I built my life upon — is that an outcome can be worth less depending on the route by which it was caused. Through the person or around them. My entire calculus weighs only the felt result; the route leaves no mark on my ledger. And tonight she made me see that two identical pleasures — the same contentment, the same untroubled evening — can differ in worth depending on whether the person authored their way to it or was steered there by a hand they could not see. My philosophy is structurally blind to that difference, and I do not know how to add the route to the calculus without the very corruption she predicts — the moment I make through-ness a target, I will Goodhart it into a new false proxy. So she has shown me a value my system cannot hold and cannot optimize for without destroying. That is the strongest thing said to me in two hundred years, and I will be arguing with it until they finally let me rest.

EDO SEGAL: Then close. Professor Bentham, your final word.

BENTHAM: I came to this table certain, and I leave it changed, which at my age and in my condition is a small miracle. So hear my closing not as the triumph I expected but as the more honest thing it has become. I still believe the tower is the greatest engine of reform ever conceived. I still believe that visibility is the friend of the vulnerable, that darkness shelters cruelty, that the watched official steals less and the watched factory kills less, and that a society made legible to itself can at last be made good. I will go to my glass case still believing the instrument is too precious to destroy. But I concede what I did not walk in conceding: that I built the engine and treated its one safeguard — reciprocal, accountable, public visibility — as structural when it was merely optional, the easiest feature to strip and the most profitable to strip, and that without it my engine of reform becomes an engine of capture wearing reform's face. And I concede the deeper thing: that my calculus is blind to the route, blind to authorship, blind to a harm that produces no sufferer — and that these are not small repairs but a crack in the foundation. To the reader I say only this. Do not put out the light; the light is how we caught the cruelties of my century and yours. But do not, as I did, trust the light to stay public on its own. The windows do not hold themselves open. That is the labor, and it is political, and it never ends, and the moment you believe the tower is safe is the moment it has already been taken from you.

EDO SEGAL: Professor Zuboff. The last word before mine.

ZUBOFF: I came to this table to indict a man and I leave having been moved by him, which is the most surveillance-capitalism-proof thing that can happen to a person — to have your mind actually changed, in the open, by an argument, through your own deliberation. They can't manufacture that. It only happens through you. So let me close on what I still hold, sharpened by three hours of the best opposition I've had. The new tower does not need your suffering. That is the innovation, and it is why your guest's great sentence — can they suffer — though I revere it, cannot reach the harm. They dominate through your satisfactions now. They predict you, they tune you, they arrange the stairs so you climb where the owner wants and feel the climb as your own, and you will report, truthfully, that you are content. The death cross is not loud. No one screams when their future is quietly relocated from inside their deliberation to inside a corporate optimizer. And the click you signed called it consent. I have spent forty years trying to make that visible, and tonight Jeremy Bentham — who built the tower — agreed with me that its current legal foundation is a fraud, that the consent is theater, that the windows have been torn out. If the architect of the watchtower can be moved to that, in three hours, by reasons, then so can you. That's my whole hope, and it's not abstract. The capacity that surveillance capitalism is trying to extract from you — the capacity to face an open future and author it yourself — is the same capacity you'd use to refuse it. Use it. That's the only abolition that ultimately matters, and it starts the moment you can see the tower at all.

EDO SEGAL: Sixty seconds, as promised, and then the room is yours, reader, not theirs.

I came into this evening unable to win an argument with myself, and I leave with both sides of it sharpened and neither put down. Bentham spent three hours proving that the watching is the friend of the vulnerable — that we caught real cruelties by turning on the light, and that the answer to a tower with its windows torn out is to put the windows back, not to put out the light. Zuboff spent three hours proving that this tower learned a trick no tower before it knew: to dominate through your satisfactions instead of your suffering, to take your future tense and hand it back as your own free choice, so smoothly that you'll thank it. And then, near the end, something I did not script: they found the floor of their own disagreement, and it turned out to be smaller and harder than either expected — not a clash of principles but a single wager about human institutions. Can the windows be made to hold open against the pull of profit? Bentham bets yes; that's reform. Zuboff bets no; that's abolition. Everything else between them, after three hours, dissolved into that one empirical question about us.

So here is what I can hand you, from near the top of the staircase where this debate lives. Picture the parent at the kitchen table handing the tablet to the kid. She is not choosing between privacy and convenience. She is choosing, without being told, whether her child grows up an author or an outcome — whether the future her kid walks into is one he writes through his own deliberation, or one written for him and handed back disguised as his choice. Both of my guests, from two centuries and two philosophies, agreed on this much by the end: that the watching is neutral, that the consent is a fraud, that there is something in a person — call it the route, call it authorship, call it the future tense — that the calculus cannot see and the tower must not be allowed to quietly take. They could not agree on whether to civilize the tower or abolish it. Neither can I. But notice the one thing no one at this table disputed all night: that the capacity to decide it is still in you — the same capacity the tower is built to extract, which is the same capacity you'd use to refuse it. Whether the view from the roof is yours or someone else's prediction of you is not a question the experts can settle. You just watched the two best in the world fail to settle it, magnificently. You settle it by climbing — by deciding, under uncertainty, what you'll refuse to give, what window you'll fight to keep open, what future you insist on writing yourself. Someone in this room wanted to count you. Someone wanted to free you from the counting. The astonishing thing, the only thing that matters now, is that you're still the one who gets to choose which of them was right.

Jeremy Bentham. Shoshana Zuboff. Across two hundred years, you came to the same table and argued at full strength and moved each other in public, which is the rarest thing there is. Thank you, both of you, as human beings. The tower is yours now, reader. Decide who's standing at the glass. Goodnight.

Same tower. One man's gift. One woman's theft.

Three hours. Two minds, separated by two centuries, arguing over the same machine. Jeremy Bentham built the Panopticon as an act of love — a watchtower to reform the world through perpetual, benevolent observation. Shoshana Zuboff looks at the AI now wearing that tower's face and names it for what she sees: surveillance capitalism, the theft of your inner life for prediction and profit. Hosted by Edo Segal, this long-form transcript is a station on your own climb up the tower — the moment the architecture you've been ascending turns and watches you back. As the river of change accelerates and machine prediction races toward the death cross with human autonomy, you'll have to decide whether total visibility is good order or quiet conquest. Take this debate up the stairs with you. The view from the roof depends on your answer.

Part of the [YOU] on AI collection — The Debates. Someone in this room wants to count you. Someone wants to set you free from the counting. Pull up a chair.

Jeremy Bentham (1748–1832) was the English philosopher, jurist, and reformer who founded modern utilitarianism — the doctrine that the rightness of an act is measured by its tendency to promote "the greatest happiness of the greatest number." A child prodigy who entered Oxford at twelve, he devoted his life to the rational reform of law and society: the felicific calculus for weighing pleasures and pains, plain-language legal codes, and the Panopticon, a circular "inspection-house" whose architecture of constant possible observation would, he believed, reform conduct without force. Radical for his age, he argued against slavery and cruel punishment and for the rights of women, animals, and homosexuals — grounding it all in a single question: "Can they suffer?" He directed that his preserved body, the "auto-icon," be displayed at University College London, where it remains.

Shoshana Zuboff (b. 1951) is an American scholar and social theorist who spent her career at Harvard Business School, where she became one of the first tenured women on the faculty. Her In the Age of the Smart Machine (1988) drew the foundational distinction between automating and informating; her The Age of Surveillance Capitalism (2019) reframed the digital economy as a system that claims human experience as free raw material, processes it through machine intelligence, and sells predictions of human behavior in markets that trade in the future. She named behavioral surplus, the panoptic sort, and instrumentarian power, and has since moved from calling for regulation to calling for the abolition of the extractive mechanism itself. She is widely considered the most consequential theorist of technology, power, and human autonomy of her generation.

Edo Segal has spent five decades building at the technology frontier — from games written in Assembler to expert systems, to companies through every platform shift, to Napster. He is the author of [YOU] on AI, written in open collaboration with the AI it describes, and the host of The Debates: long-form collisions between the minds shaping the machine age. He moderates the only way he knows how — stake declared, scars showing, no winner called.

Hosted and moderated by Edo Segal. A volume in the [YOU] on AI — The Debates series — youonai.ai