CONCEPT
The Homunculus Fallacy
The persistent cognitive habit of smuggling a little person into the machine to explain how the machine does what it does — installed by the observer, not discovered in the system.
The homunculus fallacy is the tendency, documented across centuries of philosophy of mind, to explain intelligent behaviour by positing a smaller intelligent agent inside the system doing the work. The eye sees because a little person inside looks at the retinal image; the brain thinks because a little person inside the brain processes thoughts; the machine understands because something in there is home, understanding. The explanation is recursive — it doesn't explain anything, since the little person's intelligence needs the same explanation as the original system's — but the fallacy is seductive precisely because it feels explanatory. Midgley identified the homunculus fallacy as a characteristic error of the AI discourse: when users cannot imagine how the machine's outputs could be so good without someone being home, they install a ghost in the machine rather than accept that the outputs are produced by mechanical statistical prediction over very large datasets.
In The You On AI Field Guide
The classical target of the homunculus