CONCEPT
Structural Vigilance
The reflexive extension of incrementalism required to address gradual disempowerment — evaluating each incremental step not only against immediate consequences but against its effect on the democratic system's capacity to take different steps in the future.
Structural vigilance is the modification that incrementalism must adopt to address the specific failure mode gradual disempowerment identifies. Standard incrementalism evaluates each intervention against its marginal consequences. Structural vigilance adds a second evaluative criterion: does this step preserve or erode the capacity for future democratic choice? The question transforms incrementalism from a method of policy-making into a method of institutional self-preservation. The question is harder. It requires looking past immediate consequences to the cumulative effect of many steps on the conditions under which future steps will be chosen.
In The You On AI Field Guide
The concept responds to a genuine challenge to the incrementalist framework. The January 2025 paper on gradual disempowerment by Jan Kulveit and colleagues argued that the most dangerous pathway to catastrophic AI outcomes is the slow, incremental one: step by step, each individually reasonable, humanity cedes decision-making authority to AI systems until the cumulative transfer becomes effectively irreversible. The paper described a catastrophe that