CONCEPT
Race Dynamics
The multi-player prisoner's dilemma at the heart of frontier AI development — each company acts rationally given competitors' behavior, no company can slow unilaterally without ceding the frontier, and the system-level outcome is worse than any participant intended.
Race dynamics is Amodei's name for the most dangerous structural feature of the AI development landscape — more dangerous than any specific technical risk, because race dynamics amplify every specific technical risk by reducing the time and resources available to address them. The situation is a multi-player prisoner's dilemma: each company would benefit from an industry in which all companies invested heavily in safety, but each company also has an incentive to free-ride on competitors' safety investments. The result is systematic underinvestment in safety, not because any individual company wants less safety but because the structure of the competition makes less safety the rational individual strategy. The dynamics also operate internationally and at the level of individuals within firms.
In The You On AI Field Guide
The competitive dynamics have a specifically dangerous property that game theory illuminates clearly. Each participant would prefer to slow down, given assurances that other participants would slow down too. No