Sensorimotor Contingencies

In The You On AI Encyclopedia

The sensorimotor contingency theory was first articulated in J. Kevin O'Regan and Alva Noë's 2001 paper 'A Sensorimotor Account of Vision and Visual Consciousness' in Behavioral and Brain Sciences, which became one of the most cited and debated papers in consciousness studies. The paper argued that visual experience is not produced by constructing internal representations but by engaging in an active exploration of the environment governed by knowledge of sensorimotor contingencies — the lawful patterns by which visual inputs change with movement.

The theory explains several features of perception that the representational model struggles with. Change blindness — the failure to notice dramatic visual changes during saccades or interruptions — makes little sense if the visual system constructs detailed internal representations. It makes perfect sense if the visual system engages in active exploration governed by task-relevant contingencies. Sensory substitution, in which blind users learn to 'see' through tactile or auditory inputs, makes little sense if the sensory input determines the character of experience. It makes perfect sense if experience is determined by the perceiver's skilled use of the available sensorimotor contingencies.

For AI, the theory has direct implications. A system that lacks a body cannot possess sensorimotor contingencies — cannot know what it is like to see, because seeing is not the processing of visual data but the active, embodied exploration of a visual environment. A large language model trained on descriptions of vision has extensive propositional information about seeing without any of the practical knowledge that constitutes seeing itself. The distinction is not technical but categorical: the model has knowledge that about visual perception without any knowledge how.

The theory has been extended by Noë and others to perception in all modalities, to bodily awareness, and to cognition more generally. The central claim — that perceptual experience is constituted by the perceiver's practical mastery of sensorimotor patterns — is the operational core of the enactive approach and the specific technical mechanism by which embodiment is claimed to be constitutive of cognition.

Origin

J. Kevin O'Regan and Alva Noë, 'A Sensorimotor Account of Vision and Visual Consciousness', Behavioral and Brain Sciences 24 (2001), 939–1031. Extended in Noë's Action in Perception (2004) and related papers.

Key Ideas

Perception as skilled exploration. To perceive is not to receive input but to exercise practical knowledge of how input changes with movement.

Implicit knowledge. Sensorimotor contingencies are known bodily, not propositionally.

Modality-specific patterns. Vision, touch, and audition each have distinctive contingency patterns that define what it is to perceive in that modality.

Change blindness vindicated. The failure to notice visual changes supports the view that we do not construct detailed internal representations.

AI's missing dimension. A disembodied system has no sensorimotor contingencies to master and therefore no perception in the full sense.