CONCEPT
Ultrastability
Ashby's name for the double feedback loop that enables a system to reorganize its own rules when its current rules can no longer keep its essential variables alive—the architecture of self-correction, and the source of alignment's deepest paradox.
Ultrastability is the property that distinguishes adaptation from mere stability. A merely stable system returns to equilibrium after a nudge, within its fixed rules. An ultrastable system, faced with a disturbance so severe that no response within its current rules can keep its essential variables in bounds, reaches into its own organization and
reorganizes the rules—tries new configurations, through blind search or gradient descent, until it finds one that maintains viability. W. Ross Ashby demonstrated the principle with the homeostat (1948), four surplus bomb-control units that thrashed, searched, and settled into new configurations against novel disturbances. The double loop is the key: a fast loop of behavior, and a slow loop that monitors whether the fast loop is working and rebuilds it when it is not.
Reinforcement learning from human feedback is ultrastability industrialized: the reward signal stands in for the essential-variable monitor, and the gradient update is the mechanism of reorganization. The concept lives at the center