CONCEPT
The Builder's Obligation
Amodei's principle that the creators of powerful AI systems bear moral responsibility for what those systems do — an obligation that cannot be outsourced to users or regulators and that requires advancing safety science, publishing findings, resisting commercial pressure, and participating in institutional design.
The builder's obligation is Amodei's articulation of the specific moral responsibilities borne by the creators of powerful AI systems. The obligation extends beyond the technical requirement of building safe systems to include: advancing the science of safety through research whose immediate commercial value is zero but whose contribution to collective understanding is substantial; publishing safety findings as a public good even when publication educates competitors; resisting commercial pressure through institutional structures specifically designed to make resistance possible; and participating actively in institutional design rather than waiting for governance frameworks to emerge. The obligation cannot be outsourced to users or regulators because the builders possess unique knowledge about the systems' capabilities and limitations.
In The You On AI Field Guide
The obligation's first dimension — advancing safety science — requires investing in research whose near-term commercial value is minimal. Interpretability research is the paradigmatic example. The research is expensive,