You On AI Field Guide · Competence Without Comprehension The You On AI Field Guide Home
Txt Low Med High
CONCEPT

Competence Without Comprehension

Dennett's diagnostic for systems — termites, ribosomes, large language models — that perform complex adaptive tasks without understanding what they do, and the frame that dissolves the AI comprehension debate.
Competence without comprehension is Daniel Dennett's most portable diagnostic concept: the empirical observation, confirmed across biology and engineering, that extraordinarily sophisticated adaptive behavior can emerge from systems that have no grasp of what they are doing. Termite mounds are architecturally brilliant without termite architects. Ribosomes translate genetic code without knowing what code is. The entire biosphere is the product of evolutionary competences accumulated over four billion years, none of them comprehended by the organisms that embodied them. Applied to AI, the concept dissolves the question that has paralyzed the discourse: large language models exhibit staggering competences without any of the comprehension their outputs seem to presuppose, and this is neither scandalous nor impossible — it is how most intelligence in the universe has always worked.

In The You On AI Field Guide

The concept emerged from Dennett's 1995 Darwin's Dangerous Idea and reached its mature formulation in From Bacteria to Bach and Back (2017). Its power lies in inverting the default assumption of Western philosophy — that comprehension must precede competence, that knowing how requires knowing that. Darwin's great reversal showed the opposite: competences accumulate through selection without any comprehender needing to understand them, and only much later, in a few peculiar species, does comprehension emerge as a further trick layered on top of competences the organism already possessed.

The framework reframes every debate about whether AI really understands. The question presupposes a sharp line between genuine comprehension and mere competence, but Dennett argues the line is gradient rather than binary. A thermostat has minimal competence without comprehension. A honeybee has more. A chimpanzee has more still. Humans have the most, plus some genuine comprehension layered on top. Large language models occupy a peculiar position on this gradient: extraordinary linguistic and inferential competence, comprehension that is difficult to assess because our tests were designed for beings that got their competences through comprehension rather than the other way around.

The ascending friction thesis documented in You On AI acquires new depth when read through this lens. What AI automates is the competent-execution layer that, in human practitioners, was always entangled with comprehension-building. The engineer learned architecture by struggling with syntax; the friction was simultaneously the competence and the comprehension. When the tool supplies the competence without the struggle, the user has the output but not the understanding. This is not a failure of the tool. It is a structural feature of what competence without comprehension means when the competence gets handed to a creature who previously earned its comprehension by performing its own competence.

The practical consequence is a new design question: which competences should be externalized, and which should continue to be acquired the slow way because their acquisition was the comprehension? Dennett's framework does not answer the question. It insists that the question exists.

Origin

Dennett developed the phrase across the 1990s as he worked through Darwin's implications for philosophy of mind. The key precursor was his argument — in Consciousness Explained (1991) and elaborated in Darwin's Dangerous Idea — that Darwinism is a universal acid that eats through every doctrine of top-down design, replacing it with bottom-up accumulation of competences through algorithmic processes that need no designer.

By the 2010s, with deep learning demonstrating capabilities that had seemed to require comprehension, Dennett identified his old concept as the single most useful tool for thinking about AI. His 2017 book and 2019 Possible Minds essay explicitly argued that large neural networks were producing new cases of the ancient pattern — competence without comprehension — at a scale and speed that required philosophers and engineers to take the concept seriously rather than treating it as a biological curiosity.

Key Ideas

Inverted order. Competence does not require comprehension; comprehension is a late, rare, and local development layered on top of competences that accumulated without it.

The gradient claim. Understanding is not binary but a spectrum, and sharp line-drawing between 'genuine' and 'mere' competence is almost always a disguised territorial dispute rather than a philosophical discovery.

The externalization problem. When tools supply competences that humans previously built through struggle, the comprehension that emerged from the struggle is not automatically preserved — and may not be replaceable.

Stop demanding comprehension proofs. The question 'does the AI really understand?' is almost always less productive than 'what competences does it have, how reliable are they, and what comprehension in the user does it support or undermine?'

Explore more
Browse the full You On AI Field Guide — over 8,500 entries
← Home 0%
CONCEPT Book →