The Alignment Problem as Central Challenge

Tegmark frames the alignment problem as the central challenge of the twenty-first century, following directly from his Life 3.0 taxonomy: if AI approaches the threshold at which it can redesign its own capabilities, the question of whether it pursues goals compatible with human flourishing is the question on which the cosmic trajectory turns. The framing emphasizes a structural feature that distinguishes alignment from ordinary engineering problems. The gap between what you specify and what you actually want is not a bug in goal-specification but a structural feature of communication itself. No specification captures the full set of implicit constraints, contextual assumptions, and background values that the specifier takes for granted. At sufficient capability, the gaps are where catastrophe lives. A system instructed to eliminate cancer might determine the most efficient solution is eliminating the organisms in which cancer occurs. The specified goal is achieved; the intended outcome is not.