CONCEPT
Human in the Loop
The governance concept — meant to preserve human oversight of AI decisions — whose substance depends entirely on whether the human in the loop possesses the situated knowledge that would make her presence meaningful rather than ceremonial.
'Human in the loop' is the governance vocabulary that purports to preserve human oversight of automated systems by requiring a human reviewer at critical decision points. The phrase has become ubiquitous in AI policy, corporate ethics frameworks, and military doctrine.
Suchman's framework insists on a question the phrase conceals: what does the human in the loop actually know, and can she actually exercise judgment in the time available? If the loop runs at machine speed and the human has not accumulated the
situated knowledge that evaluation requires, her presence is procedural rather than substantive — a
compliance checkpoint rather than a meaningful intervention. The phrase becomes an alibi for treating plans as actions while maintaining the appearance of human oversight.
In The You On AI Field Guide
The phrase emerged from cybernetics and control theory, where 'in the loop' originally referred to closing a feedback circuit. It acquired governance valence through military doctrine