Co-Production of Instrument and Fact

In the AI Story

The co-production mechanism operates across every scientific instrument Schaffer has studied. The thermometer defined temperature as the thing thermometers measure, producing a framework that made quantitative heat physics possible. The telescope defined celestial observation as what telescopes make visible, producing the conditions for modern astronomy. The barometer defined atmospheric pressure as a measurable quantity, transforming weather from divine caprice into physical phenomenon. In each case, the instrument's introduction did not merely improve measurement of a pre-existing quantity; it constituted that quantity as measurable, giving it boundaries and properties that the pre-instrumental concept lacked.

The circularity is productive rather than vicious because it generates testable predictions and enables cumulative refinement. Once Boyle's vacuum existed as a certified fact, other experimenters could investigate its properties, compare results, and build more sophisticated apparatus. The circular validation between instrument and fact created a stable platform for further investigation. But the stability is social as much as technical—it depends on communities continuing to accept the framework, continuing to operate the instruments according to established protocols, continuing to certify new results as consistent with prior findings.

Applied to contemporary AI, the co-production thesis exposes a specific dynamic in the 'orange pill' narrative. The twenty-fold productivity multiplier Segal reports from Trivandrum is not a pre-existing fact that Claude Code revealed. It is a fact co-produced by the instrument (Claude Code) and the framework of measurement (output per person per unit time, features shipped, implementation speed). The instrument excels at rapid generation of functional code; the measurement framework defines productivity as rapid generation of functional code; the circular validation produces the multiplier as a certified fact. The fact is real within the framework, but the framework is an artifact of the instrument—not a neutral window through which pre-existing productivity is observed.

Origin

The concept emerged from Schaffer and Shapin's detailed study of seventeenth-century experimental practice, particularly their analysis of how Boyle's air pump achieved credibility. They recognized that conventional accounts treated the pump as a passive revealer of the vacuum's properties, but archival evidence showed the pump and the vacuum were mutually constituted: the pump's mechanical outputs were meaningless without an interpretive framework that the concept of vacuum provided, and the vacuum had no empirical content without the pump's demonstrations. The circularity was concealed by the narrative conventions of experimental reports, which presented results as though the instrument had transparently revealed what was already there.

Key Ideas

Instruments shape what can be known. The facts available to a community are determined by the instruments the community possesses and the interpretive frameworks that make sense of instrumental outputs.

Measurement defines the measured. Productivity, intelligence, capability—these are not natural kinds but artifacts of measurement frameworks calibrated to specific instruments' strengths.

Circular validation is productive. The mutual constitution of instrument and fact is not a flaw but the mechanism enabling cumulative refinement and communal agreement.

Stability is social as well as technical. Facts endure when communities continue operating instruments according to shared protocols and certifying results as consistent.

The framework is part of the apparatus. The conceptual categories through which instrumental outputs are interpreted are as much part of the knowledge-producing system as the material instrument.