Segal's intelligence-as-river metaphor from You On AI illustrates the distinction. The analogy is structurally deep: both rivers and the development of intelligence involve the progressive organization of complexity through the interaction of variation and constraint, both flow through channels shaped by their history, both produce branching and convergence. But the analogy also has incidental surface features: both rivers and intelligence are described as 'flowing,' both can be 'shallow' or 'deep.' These verbal coincidences are not what make the analogy illuminating. A perceiver who thought the analogy worked because intelligence and rivers both 'flow' would miss the structural correspondence entirely.
The machine cannot reliably distinguish these two levels. It can distinguish between them only to the extent that the distinction is reflected in the statistical patterns of its training data. If the data contains many texts discussing structural correspondences, the machine's outputs will tend to reflect the structural level — not because the machine perceives structure but because it inherits understanding from the texts that do.
The Deleuze failure Segal caught during the writing of You On AI is the diagnostic specimen. Claude produced a passage connecting Csikszentmihalyi's flow to Deleuze's 'smooth space' based on verbal overlap — 'smooth,' 'flow,' 'creative freedom' co-occur in texts about both thinkers. The verbal overlap was surface; the conceptual structures in the two frameworks were fundamentally different. The machine could not tell the difference because telling the difference required deep domain-specific understanding that statistical patterns can approximate but not guarantee.
The practical consequence is that evaluating AI outputs requires asking, for every apparent analogy: Is this structural or merely verbal? Is the correspondence grounded in shared mechanism, or merely in shared terminology? The evaluation cannot be automated — it requires the human evaluator to possess enough understanding of both domains to distinguish essential from incidental features.
The distinction runs through Hofstadter's work from the beginning but reaches its fullest development in Surfaces and Essences (2013), co-authored with Emmanuel Sander. The framework has become standard in cognitive science discussions of analogical reasoning and is central to Hofstadter's critiques of AI systems that produce outputs looking analogical without doing the structural work.
Essential vs incidental features. Every comparison contains both; the art is distinguishing them.
Surface as misleading. Surface similarity can exist without structural correspondence.
Structure as earned. Perceiving structural similarity requires deep domain knowledge.
Verbal overlap traps. Shared terminology often signals surface, not structure.
The evaluation asymmetry. Only minds with structural understanding in both domains can reliably distinguish deep from shallow analogies.