CONCEPT
Gesture as Spatial Thought
Tversky's finding that hand movements during speech are not communication aids but integral components of the cognitive process itself — we literally think with our hands.
Gesture research has progressively overturned the view that hand movements merely accompany speech. Tversky's work, alongside Susan Goldin-Meadow's, demonstrates that gestures encode spatial relationships that the speaker may not be able to articulate verbally, that blocking gesture impairs spatial reasoning, and that speakers gesture even when no one is watching. Gesture is part of how thinking happens, not a byproduct of thinking already completed. The implication for AI collaboration is stark: text-only interfaces systematically discard the gestural channel through which much
spatial cognition occurs, impoverishing the communication
between builder and machine.
In The You On AI Field Guide
When a builder describes a user flow to a colleague in person, her hands trace the temporal sequence — user approaches here, face is detected there, the response occurs above. These spatial encodings carry information that the accompanying words often leave implicit or ambiguous. The colleague absorbs the spatial structure through the gestural channel even when the verbal channel is incomplete. When the same builder types