Jerry Fodor

In the [YOU] on AI Field Guide

The cycle asks what these systems actually are, beneath the fluency. Fodor is the thinker who most precisely arms the reader for that inquiry. His central distinction—between a system that has a property and a system that behaves as if it had one—is the instrument the cycle most needs when confronted with AI outputs that sound like understanding, look like reasoning, and pass tests that were once reserved for minds. He was not opposed to machines that think; he was opposed to the confusion of fluent output with the structure that produces it, and that confusion is everywhere in the current discourse.

His modularity thesis, which came in two halves, illuminates the AI landscape with unusual precision. The comforting half—that perception and language are modular, fast, and tractable—is the half the field has instinctively moved toward, building specialized models for specialized tasks, retrieval systems that fetch facts from sealed stores, mixture-of-experts architectures that route inputs to dedicated sub-networks. The devastating half—that central cognition, the system that reasons, decides, and draws on everything you know at once, is precisely not modular and is for that reason not understood—is the half that the cycle keeps returning to, because it is where the machines most conspicuously struggle. The hallucinations, the coherence failures, the inability to hold a long argument together without contradiction: these are the signatures of a system that handles the local and the modular with grace and fails at exactly the global, integrative cognition that Fodor declared beyond computational reach.

The challenge of 1988, which Fodor issued with Zenon Pylyshyn to the connectionist movement that would eventually produce the large language model, is the most important specific argument in this context. The challenge rested on two properties of thought—systematicity and productivity—that Fodor held could only be explained by compositional symbolic structure, not approximated by connection weights. The machines have since displayed both properties to a degree no one expected, and the honest question is whether they answered the challenge or merely met it at a level of coverage broad enough that the underlying difference is hard to find. Fodor’s framework predicts where to look: at the edges of the training distribution, where genuine compositional structure and statistical approximation of it come apart.

His contribution to the cycle’s humanistic concerns is less about the machines than about the thinking we bring to them. He was the clearest available voice for the proposition that fluency is not intelligence, that the output tells you nothing about the process, and that the question of what is inside a system matters independently of how well the system performs. In an age that tends to slide from impressive performance to strong claims about machine minds, this insistence on structural rather than behavioral criteria is exactly the discipline the cycle needs.

Origin

Jerry Fodor was born in New York in 1935 and spent most of his career at MIT and Rutgers, dying in 2017 the year before the systems that would most decisively test his framework arrived. He was a polemicist by temperament—relishing argument, attacking positions he thought confused, picking fights with behaviorists, connectionists, evolutionary psychologists, and Darwinians with equal energy—and the polemical style could obscure the depth of the philosophical work beneath it. He was also, by most accounts, the most important philosopher of mind of his generation.

The Language of Thought hypothesis, proposed in the 1975 book of that name, was Fodor’s foundational contribution: the claim that thinking is done in a mental language, with its own symbols and its own combinatorial syntax, prior to and independent of any spoken tongue. When you believe that the cat is on the mat, there is, on this account, a structured representation in your head, composed of a symbol for the cat, a symbol for the mat, and a relation between them assembled according to rules. The belief has parts, and the parts are the same parts that show up in other beliefs. This is not a metaphor; it was a literal hypothesis about the format of cognition.

The Modularity of Mind (1983) added the second great contribution, arguing that the mind is divided into specialized, informationally encapsulated input systems—modules that do their work in sealed isolation from the rest of what you know—and a central system that reasons, decides, and draws on everything at once, whose non-modular character was, he argued, the deepest reason why cognitive science could explain the peripheral and not the central. His 2000 book The Mind Doesn’t Work That Way sharpened this into a thesis about the limits of the whole computational approach: global, abductive reasoning—inference to the best explanation from the totality of one’s beliefs—cannot be mechanized by operating on the local syntactic properties of representations, and since central cognition is precisely such reasoning, the computational theory of mind, however good at the modules, cannot explain the thing that matters most.

Key Ideas

The Language of Thought. Genuine thinking requires a system of internal symbols—Mentalese—with two faces: a syntactic shape that a mechanical process can manipulate, and a semantic content that the shape carries. Computation that works by manipulating the shapes while respecting the meanings is the only account, Fodor held, of how thought can be at once physical and rational. A large language model operates on vectors, not symbols in this sense, and the question whether a sufficiently structured vector space can implement what a Language of Thought is—whether the two are levels of description of the same thing rather than alternatives—is the live technical debate his framework generates.

Modularity and its limits. The mind’s input systems—vision, language—are fast, domain-specific, and informationally encapsulated, each doing its work without consulting the rest of what you know. This encapsulation buys reliability at the cost of flexibility. The central system, which integrates the outputs of the modules and reasons across the full web of belief, is not modular, and for that reason not understood. The field has begun rediscovering the value of modularity—specialized sub-models, retrieval systems, routing architectures—and in doing so has converged, slowly and without quite admitting the lineage, on the modular design Fodor described. But the part he said we did not understand remains the hardest: the global, integrative, relevance-sensitive reasoning that the machines most conspicuously fail to perform reliably.

Systematicity and productivity. Fodor and Pylyshyn argued in 1988 that any mind that can think one thought can think the systematically related thoughts—anyone who can think John loves Mary can think Mary loves John—and that this systematicity follows necessarily from compositional structure, not contingently from training. A connectionist system could mimic systematicity but not explain it. The machines of our moment display systematicity far beyond what anyone then imagined—and the Fodorian question is whether they display the principled, exceptionless kind that follows from genuine structure, or the statistical, coverage-bounded kind that follows from having seen enough examples. Careful probing of compositional generalization benchmarks suggests the latter: the machines are systematic within the distribution they have seen, and brittle at its edges, in exactly the way approximation rather than structure predicts.

The frame problem and abduction. Central cognition is global and abductive: it draws on everything you know, assesses candidate beliefs by how they fit the whole web, reasons to the best explanation. These are properties of whole belief systems, not of individual symbols, and a process that works on the local syntactic properties of representations has no access to them. The frame problem—how a system knows which of everything it knows is relevant to the situation at hand—was the rock on which classical symbolic AI broke, and Fodor held it was a conceptual impossibility, not merely an engineering difficulty. The large language model addresses the frame problem by a different means: absorbing the statistical structure of relevance from vast text corpora, learning implicitly which things tend to go with which. This approximates relevance without computing it, and fails precisely where approximation fails: on situations where the unusual relevance is decisive and the statistical tendency misleads.

The third thing. Fodor framed the science of mind as a war between symbolic and connectionist approaches, assuming they exhausted the options. The large language model is neither: connectionist in its substrate, displaying symbolic-looking behavior in its conduct. It is a statistical approximation of a symbol system—implementable in a distributed substrate, achieving compositional behavior by learning the patterns that compositional structure produces, exhibiting systematicity and productivity across the bulk of the distribution while failing at its edges in ways that genuine structure would not. Fodor gave us the wrong taxonomy and the right concepts, and the concepts—the distinction between having a property and approximating it, between structure that is built in and structure that is learned—are what let us see what the machines are.