You On AI Field Guide · Automation Complacency The You On AI Field Guide Home
TxtLowMedHigh
CONCEPT

Automation Complacency

The measurable, involuntary reduction in cognitive engagement that occurs when human operators are repositioned from active practitioners to passive monitors of automated systems—a neurological response, not a moral failure.
Automation complacency is the clinical name for a finding so regular across aviation, medicine, navigation, and finance that it can be stated as a structural law: when a machine takes over a task, the human who handed it over becomes progressively less capable of performing that task without the machine, and less effective at monitoring the machine while it performs it. Nicholas Carr drew the concept from decades of human factors research—most dramatically from aviation studies by Earl Wiener at the University of Miami, whose work documented that automated cockpits did not eliminate pilot error but transformed it, shifting it from errors of execution to errors of understanding, from wrong actions to the failure to comprehend what the automated system was doing or to intervene when it encountered conditions beyond its design envelope. The complacency is not chosen. It is the default outcome of a nervous system that evolved to conserve metabolic resources by pruning neural circuits that are not being exercised—a system that cannot distinguish between
← Home0%
CONCEPTBook →

Keep reading with YOU ON AI

Unlock the full book, 10,000+ field-guide entries, and a 1000+ thinker library. If you have a book code, register now — it takes a minute.

Register with book code Sign in