You On AI Field Guide · The Operator's Dilemma The You On AI Field Guide Home
Txt Low Med High
CONCEPT

The Operator's Dilemma

The structural contradiction at the heart of human-automation coupling: the operator is asked to supervise a system whose normal performance exceeds her own, and to intervene in exceptional situations that exceed the system's capability — a role that requires her to be simultaneously subordinate to the machine and superior to it.
The operator's dilemma, articulated through Bainbridge's framework and sharpened by Charles Perrow, describes the epistemically impossible position in which automation places its human supervisors. During normal operation, the automated system performs better than the operator would — faster, more consistently, without fatigue. The operator is in a clear sense the junior partner. During exceptional operation, the automated system fails or encounters situations outside its envelope, and the operator must become the senior partner, making judgments the machine cannot make. The transition between these roles is instantaneous, unpredictable, and occurs under exactly the conditions least favorable to performing it well. The operator is asked to maintain two incompatible postures — trust in the machine during normal operation, skepticism of the machine during abnormal operation — and to switch between them at the moment when switching is hardest.
The Operator's Dilemma
The Operator's Dilemma

In The You On AI

← Home 0%
CONCEPT Book →

Keep reading with YOU ON AI

Unlock the full book, field guide, and 555-thinker library. If you have a book code, register now — it takes a minute.

Register with book code Sign in