CONCEPT
Ironies of Automation
Lisanne Bainbridge's 1983 insight that automation does not simply remove the human from a task — it transforms the human's role into monitoring, which humans do badly.
"Ironies of Automation" is Lisanne Bainbridge's landmark 1983 paper in Automatica that identified the structural problem built into any design philosophy that automates as much of a task as possible while leaving humans as backup operators. As automation takes over more of the task, the human operator's remaining responsibilities — supervising the automation, handling edge cases — become harder, not easier. Humans are poor monitors of reliable systems; they lose, through disuse, the skills that would let them recover when the automation fails; and the cases left to them are by definition the hardest. Every subsequent framework for automation design — airline cockpit human factors, autonomous-vehicle handoffs, medical-device alarms, AI-assisted workflows — sits downstream of Bainbridge's insights.
In The You On AI Field Guide
Bainbridge's paper is the operational counterpart to fictional worries about automation dependence. If Asimov's Solarians are the speculation, Bainbridge is the instrument panel. Her paper is short (seven pages), not mathematical, and named one of the most cited documents in