The Gravitational Wave Physics Community

In the AI Story

Collins's major works on the community include Changing Order (1985), which established the experimenter's regress, Gravity's Shadow (2004), which documented the decades-long search for the first detection, and Gravity's Ghost and Big Dog (2013), which analyzed how the community processed ambiguous potential signals. The 2015 LIGO detection vindicated the community's persistence and provided Collins with the empirical endpoint his framework had been building toward.

The community's relevance to the AI question is direct and specific. As the Collins and Thorne 2026 paper demonstrates, the community's reasoning practices provide a sharp test case for distinguishing mimeomorphic from polimorphic competence. When physicists evaluate a claim, dismiss a fringe paper, or debate whether an anomaly deserves further investigation, they deploy forms of reasoning that draw on the community's collective tacit knowledge — knowledge that is maintained through ongoing social practice and not fully captured in published literature. Language models trained on the community's publications can mimic the surface of this reasoning. They cannot reproduce its substance, because the substance is social.

The methodological lesson for AI evaluation is that sustained ethnographic engagement reveals what distant statistical analysis cannot. Collins's decades inside the community gave him access to the hallway conversations, the private judgments, the unspoken standards that constitute the community's actual intellectual life. A language model has access to the community's published output. The gap between these two forms of access is the gap between interactional and contributory expertise — and it is precisely where AI evaluation systematically fails.

Origin

Collins began fieldwork on gravitational wave physics in the 1970s, initially studying Joseph Weber's controversial detection claims. The engagement continued for over four decades, producing a body of empirical work that constitutes one of the most sustained ethnographic studies of a scientific community in the history of the field. The LIGO detection in 2015 — announced in February 2016 — provided the historical endpoint Collins had been following, and he documented the discovery process in real time through embedded participation.

Key Ideas

Ethnographic laboratory. The community served as the empirical ground on which Collins's theoretical framework was tested and refined over four decades.

The experimenter's regress. Collins demonstrated through this community that scientific controversies cannot be resolved by appeal to experimental results alone, because whether an experiment was performed correctly depends on judgments about what its results should be.

LIGO's tacit infrastructure. The 2015 detection required not only the published physics but the accumulated collective tacit knowledge of a community that had spent decades learning to distinguish signals from noise.

AI evaluation testbed. The community's reasoning practices provide sharp test cases for distinguishing fluent AI output from substantive physics judgment.