Conversations Machines Cannot Have

In The You On AI Field Guide

The incompleteness of human-AI conversation has a precise source. Claude does not occupy a position. It can argue from any moral framework — utilitarian, deontologist, virtue ethicist, Buddhist, Christian, secular humanist — but it does not hold these positions. It does not believe them. It does not live inside them. It has no stake in the outcome, no values it is unwilling to compromise, no experience of what it means to be a person who must make choices and live with their consequences.

This is not a limitation future models will overcome. It is ontological. A being that has never made a choice under genuine uncertainty, never loved a particular person and feared losing them, never stood at a crossroads and felt the weight of irrevocable commitment, cannot participate in cosmopolitan conversation. It can simulate participation. The simulation may be convincing. The difference between simulation and participation is the difference that matters most.

Genuine moral conversation involves risk. You might discover a position you held with confidence does not survive the encounter. You might find yourself moved — not persuaded, exactly, but shifted, reoriented. This risk is constitutive of the conversation's value. Appiah's Muslim friend risked having his religious convictions challenged. Appiah risked having his secular liberal assumptions exposed as parochial. Neither was guaranteed to emerge unchanged.

AI brings no vulnerability. It has nothing at stake. The user can say something that would devastate a human interlocutor, and the machine responds with equanimity — not because it possesses superior emotional regulation but because it possesses no emotions to regulate. The equanimity is not a strength. It is an absence. The risk is not that AI will replace human conversation. The risk is that the ease and efficiency of machine interaction will crowd out the harder, slower, less immediately productive human conversations that serve the moral function.

Origin

The framework draws on Appiah's engagement with Habermas's theory of communicative action and on the older conception of conversation as conversari — keeping company — that Appiah has returned to throughout his career, most fully in Cosmopolitanism (2006).

Key Ideas

Conversation is not information exchange. It is the practice of keeping company with people who see the world differently, where the difference is the medium of moral growth.

Risk is constitutive of value. Genuine moral conversation can change you. The vulnerability is what makes the encounter morally serious.

The machine holds no position. AI can represent any perspective but inhabits none. It brings no vulnerability, has no stake, cannot be changed by encounter.

The risk is crowding out. Not replacement but displacement — the harder human conversations abandoned for the easier machine interactions, with moral atrophy as the long-term consequence.