You On AI Field Guide · Small Failures and the Immune System The You On AI Field Guide Home
Txt Low Med High
CONCEPT

Small Failures and the Immune System

Petroski's analogy — precise, not decorative — that small, detectable failures function in engineering practice as immune responses function in biology: early warnings in the margin between initial deviation and catastrophic collapse, providing the window within which human intervention remains possible.
A crack in a concrete beam is not always a catastrophe. More often, it is a message — the structure reporting, from field conditions, that the stress distribution exceeds what the design anticipated. The engineer who reads the crack correctly receives an opportunity to intervene before the small failure becomes a large one. Petroski argued that this early-warning dynamic is not incidental to engineering but constitutive: the profession's inspection protocols, maintenance schedules, load testing, and factors of safety form a system oriented toward detecting failures while they are still small enough to be managed. The system presupposes a margin between normal operation and catastrophic failure — a margin within which small failures can occur without killing anyone. AI optimization, by reducing this margin in pursuit of efficiency, does not merely risk overloading structures. It eliminates the warning system itself. The optimized structure does not crack before it breaks. It breaks.
Small Failures and the Immune System
Small
← Home 0%
CONCEPT Book →

Keep reading with YOU ON AI

Unlock the full book, 10,000+ field-guide entries, and a 1000+ thinker library. If you have a book code, register now — it takes a minute.

Register with book code Sign in