CONCEPT
The Operator's Dilemma
The structural contradiction at the heart of human-automation coupling: the operator is asked to supervise a system whose normal performance exceeds her own, and to intervene in exceptional situations that exceed the system's capability — a role that requires her to be simultaneously subordinate to the machine and superior to it.
The operator's dilemma, articulated through Bainbridge's framework and sharpened by
Charles Perrow, describes the epistemically impossible position in which automation places its human supervisors. During normal operation, the automated system performs better than the operator would — faster, more consistently, without fatigue. The operator is in a clear sense the junior partner. During exceptional operation, the automated system fails or encounters situations outside its envelope, and the operator must become the senior partner, making judgments the machine cannot make. The transition
between these roles is instantaneous, unpredictable, and occurs under exactly the conditions least favorable to performing it well. The operator is asked to maintain two incompatible postures — trust in the machine during normal operation, skepticism of the machine during abnormal operation — and to switch between them at the moment when switching is hardest.