Conversation Theory

In the [YOU] on AI Field Guide

The cycle’s central argument—that the reader is the missing variable in every account of the machine—is what conversation theory proves at the level of epistemology. If meaning is made in the loop and never stored in a component, then the value extracted from an AI system is always co-produced by the human in the conversation, and the machine’s “intelligence” is an achievement of the relationship rather than a property of the model. This is the theoretical ground beneath [YOU] on AI’s insistence that a skilled user and a novice extract radically different capability from identical weights.

Conversation theory also names what current human oversight of AI systematically fails to be. Pask’s criterion for genuine human participation requires that both parties be able to model and steer each other, that agreement be reached through a real two-sided process, and that the human be changed by the loop in ways that deepen their competence. Most “human in the loop” arrangements satisfy none of these conditions: the human cannot inspect the model’s state, cannot meaningfully steer it in real time, and is not improved by the supervision. By conversation theory’s own standard, this is a loop with only one genuine participant.

Origin

The theory emerged from Gordon Pask’s earliest machine-building in the 1950s and was fully formalized in Conversation Theory: Applications in Education and Epistemology (1976). Its roots lie in cybernetics and radical constructivism—the doctrine that knowledge is actively constructed rather than passively received. Pask extended constructivism by insisting that construction is fundamentally social: knowledge is not built in isolation but in the back-and-forth of two systems, each of which is genuinely altered by the exchange. The formal apparatus he developed to make this precise—the P-individual, M-individual, and the entailment mesh of topics and concepts—was notoriously demanding, but the core claim is clear: understanding is demonstrated through the capacity to regenerate a topic’s generative procedure and hand it across the gap to a second participant who can also run it.

Key Ideas

Understanding as mutual regeneration. In conversation theory, two participants understand each other about a topic when each can take what the other has built and rebuild it, and each can confirm the rebuilding. This is a behavioral, operational definition that deliberately closes off the comfortable notion of private, untestable comprehension. It is also more demanding than the Turing test: not fooling a judge but jointly constructing and certifying shared concepts through reciprocal regeneration.

The concept as procedure, not item. A concept in conversation theory is not a static item filed in memory but a procedure—a way of producing or recognizing something that must be enacted. To hold a concept is to be able to run the procedure; to share a concept is for two participants to each run procedures the conversation certifies as agreeing. Meaning is inherently active and relational, produced live in the loop, not stored and read out.

The genuine second participant. The theory places a strong demand on the second system in the loop: it must have its own organization, maintain and reproduce itself, and be genuinely changed by the exchange. This is the criterion that makes the question of language model understanding well-posed: not whether the output is impressive, but whether there is a real second process on the other side whose own procedures constitute genuine comprehension, or only the behavioral trace that comprehension would leave.

Loop-knowing versus store-knowing. Conversation theory distinguishes live, loop-based knowledge—which exists only while the loop runs and is updated by real-world pushback—from the frozen store of a trained model. The pathology of the store is confabulation: production severed from correction, running open-loop with nothing to pull it back when it drifts from truth. Every industrial remedy for this—retrieval, tool use, agentic feedback—is a partial reconstruction of the loop the theory always demanded.