CONCEPT
Emergence and Thresholds No One Predicted
The rigorously studied phenomenon in which system-level properties appear suddenly at scale thresholds — and the structural reason no one, including AI's builders, can predict what the next threshold will produce.
Emergence is the appearance of system-level properties that cannot be predicted from the properties of the system's components. It is not a gap in understanding papered over with a fancy word; it is a rigorously characterized phenomenon in complexity science. Emergence occurs in systems with many interacting components, when the interactions are nonlinear, and typically at thresholds — below a certain scale, the property is absent; above it, the property appears, often suddenly. GPT-3's unexpected capabilities — translation, arithmetic, code generation, analogical reasoning — emerged from a simple next-word prediction objective at sufficient scale. No one designed them. No one predicted them.
In The You On AI Field Guide
The structural consequence of emergence is that the capabilities of AI systems cannot be deduced in advance of building them. This is not temporary ignorance to be resolved with better theory. It is a feature of emergent systems: the property exists only at the level of