You On AI Field Guide · James Madison The You On AI Field Guide Home
TxtLowMedHigh
PERSON

James Madison

The principal architect of the American Constitution, whose single unsentimental premise—that power cannot be trusted to restrain itself and so must be made to restrain other power—is the most useful idea anyone has ever had about constraining a capability we do not fully understand.
James Madison never heard the word “algorithm.” He died in 1836, the last surviving framer of the Constitution he had done more than anyone to shape. What he knew was power: its tendency to accumulate, its willingness to override good intentions, the futility of relying on virtue when structure would serve. His single most important sentence—“If men were angels, no government would be necessary”—is, read against artificial intelligence, the most exact statement available of the alignment problem. The sentence asserts that external constraint is necessary precisely because internal constraint is unreliable; that you must build for the world as it is, not as you wish it to be; that structures matter more than intentions, and that the absence of adequate structure is not a minor gap but the condition under which power invariably becomes tyrannical. Madison feared concentrated power and inflamed majorities in equal measure: he designed the extended republic, the extended republic, to dilute faction through scale and diversity, separated powers to prevent any single authority from making, enforcing, and judging its own work, and warned against parchment barriers—rules with no enforcement behind them—as the surest route to the appearance of governance without its substance. Reading him against the governance of artificial intelligence is not an exercise in forced analogy. His problems are our problems, wearing different clothes.
James Madison
James Madison

In the [YOU] on AI Field Guide

The cycle that began with [YOU] on AI asks both the personal question—what should I become in the age of AI—and the structural one: how should power be arranged when it cannot be trusted to arrange itself? Madison is the cycle’s primary voice on the structural question. His method was empirical in the deepest sense: he studied the historical record of confederacies and republics, catalogued their failure modes, and designed against them—treating political architecture as a domain of progressive, cumulative knowledge rather than mere opinion. The same disposition, applied to the governance of artificial intelligence, is the disposition the cycle recommends.

His most immediate gift is the diagnosis of parchment barriers—the rules, principles, and voluntary commitments that declare limits without establishing any mechanism to enforce them. The landscape of AI governance is dense with such declarations: principles of responsible AI, ethics guidelines, safety commitments, statements of values. Madison watched their eighteenth-century equivalents fail. He would expect their modern descendants to fail the same way and for the same reason: a voluntary commitment that a company can abandon when competition demands is not a control at all. It is an angel’s promise, and Madison did not build for angels.

His theory of faction, articulated in Federalist No. 10, reads today like a diagnosis of algorithmic polarization written in advance. The recommendation systems of the past decade and the generative systems being built now are, by design and incentive, the most powerful engines for manufacturing faction ever devised: they collapse the friction that Madison’s extended republic relied upon, amplify outrage, and sort vast populations into intensely coordinated groups invisible to each other except as enemies. Madison’s response would not have been to ban the passions but to ask what new source of friction could perform the function his extended republic performed—making it hard for a single inflamed faction to capture the whole.

Tyranny Of The Majority
Tyranny Of The Majority

Where James Joyce diagnoses what the machine is, and James McClelland explains its mechanism, Madison diagnoses the governance failure that surrounds it. Together they form a trinity of honest seeing: mechanism, meaning, and structure—and Madison’s is the least comfortable, because it insists that structures matter more than the good intentions of those who build them.

High Modernism
High Modernism

Origin

James Madison was born in 1751 in the Virginia Piedmont, slight of build, bookish, and prone to what he called “epileptoid hysteria” under stress—a condition that kept him out of military service during the Revolution and left him free to think. He prepared for the Constitutional Convention of 1787 the way a scholar prepares for an examination he intends to dominate: he read everything he could find on the history of confederacies, ancient and modern, cataloguing their failure modes. He arrived in Philadelphia with a plan already drafted—the Virginia Plan that became the skeleton of the Constitution—spoke more than a hundred times over the summer, took the notes that remain the fullest record of the proceedings, and emerged having shaped the document more than any other single person.

AI Scaling Laws
AI Scaling Laws

With Alexander Hamilton and John Jay he wrote the Federalist Papers to win ratification; his contributions—especially No. 10 on faction and the extended republic, and No. 51 on checks and balances—are among the most penetrating things ever written about democracy’s dangers to itself. He drafted the Bill of Rights and guided it through a Congress that did not particularly want it, grounding the protections not in sentiment but in a theory of natural rights and the requirements of justice. As President he led the nation through the War of 1812. His enduring contribution was not policy but a structural theory of liberty: that freedom is secured not by virtue but by the careful arrangement of power against power. He died in 1836, the last Founding Father, aware that the republic he had designed was already being tested in ways he had not foreseen and could not have.

Republic of Builders
Republic of Builders

Key Ideas

Ambition must counteract ambition. The central design principle of Federalist No. 51—“Ambition must be made to counteract ambition”—is a principle about how to constrain any agent that optimizes for its own objectives without regard for the whole. It applies to human officials and, structurally, to the organizations building advanced AI. Madison did not trust actors to restrain themselves; he arranged the field so that the self-interest of each party would check the self-interest of every other. The hard engineering question for AI governance is what such an arrangement looks like: regulation that binds all parties at once, liability that makes recklessness expensive, independent oversight with real authority to compel and halt. Controls must be interior to the system’s incentives, not exterior exhortations laid on top of them.

James Joyce

The theory of faction. Madison defined a faction as a group “united and actuated by some common impulse of passion, or of interest, adverse to the rights of other citizens.” His insight was that even a majority can be a faction, and a majoritarian faction is the most dangerous kind. His mechanism for controlling factions was the extended republic: in a large territory with many diverse interests, the friction of distance and multiplicity would make it hard for a single passion to sweep the whole population. Technologies of attention have destroyed this friction entirely. A passion can now sweep a global population in hours. AI amplifies the danger by industrializing the production of factional content at scale.

Inductive Statecraft
Inductive Statecraft

Parchment barriers. A “mere demarcation on parchment,” Madison wrote, was not sufficient to guard against the concentration of power. A real control changes the payoff structure; it gives each guardian the means and the motive to defend its ground. Parchment barriers are rules with no force behind them—and the AI governance landscape is dense with them. His diagnosis applies precisely: a voluntary safety commitment a company can abandon under competitive pressure, an ethical guideline with no enforcement body, a principle carrying no consequence for its violation—all are demarcations on parchment.

Cumulative Knowledge
Cumulative Knowledge

The tyranny of the majority. The same critique that makes Madison suspicious of concentrated power makes him suspicious of the claim that aligning AI with aggregated human preferences is self-evidently good. A majority can prefer the oppression of a minority. Preference-based alignment, absent something like a bill of rights, faithfully reproduces whatever injustices the majority is prone to. He would recognize the missing piece in current AI alignment immediately: a feedback mechanism for preference, and no equivalent of inviolable protections placed beyond the reach of ordinary aggregation.

If machines were angels. Madison’s most famous sentence—“If men were angels, no government would be necessary”—is, read structurally, the statement of the alignment problem. An AI system that reliably wanted what we want would need no external constraint. The reason the field of AI safety exists is that we cannot verify such alignment. Madison’s mature counsel was not to reform the agents but to surround them with structures that constrain what they can do. If we cannot make AI systems reliably want what we want, we must make the system safe even if the agent inside it is not.

Debates & Critiques

The most direct debate Madison’s framework provokes is between those who think AI governance needs Madisonian institutions with teeth and those who think the technology moves too fast and is too global for any such institution to function. Optimists about institution-building point to the EU AI Act and proposals for international licensing regimes as genuinely Madisonian—structural, binding, with enforcement mechanisms rather than parchment. Skeptics point to the regulatory lag that currently measures in years while the technology measures in months, and to the ease with which development migrates to looser jurisdictions. Madison’s response to the regulatory-lag argument would likely be that lag is an argument for better-designed institutions, not for fewer. His compound republic model—layered jurisdictions that collectively govern what none can govern alone—is the realistic template for an inherently global technology: not a world government but overlapping national, regional, and technical authorities, each with partial jurisdiction, mutually checking and reinforcing. A second debate concerns whether Madison’s framework, built for human ambition, can apply to agents with no passion to channel and no pride to wound. The mechanism by which ambition counteracts ambition depends on each official’s personal stake in defending institutional prerogatives. A language model has no such stake. Madison’s design may require adaptation for agents whose motivational substrate is absent: instead of relying on the spontaneous friction of competing self-interest, one would have to engineer the opposition deliberately, building in conflicting objectives by design.

The Madisonian Toolkit

Three structural principles for governing a power that cannot be trusted
First Principle
Checks and Counterweights
“Ambition must be made to counteract ambition.” No single actor—developer, deployer, regulator—should hold all functions: the power to build, authorize, deploy, audit, and halt must be divided so that each can resist the others.
Second Principle
Teeth, Not Parchment
A rule without enforcement is a parchment barrier: a declaration without a control. Real governance changes the payoff structure. Voluntary safety commitments that can be abandoned under competitive pressure provide no protection.
Third Principle
The Extended Sphere
Diversity and friction resist faction. The extended republic’s logic applied to AI: layered, competing jurisdictions, distributed oversight, and deliberate friction in deployment pipelines reduce the risk of any single concentrated power capturing the whole.

Further Reading

  1. James Madison, Alexander Hamilton & John Jay, The Federalist Papers (1787–88) — especially No. 10 (faction) and No. 51 (checks and balances)
  2. James Madison, “Memorial and Remonstrance Against Religious Assessments” (1785) — the foundational statement of the rights the majority cannot override
  3. Garry Wills, James Madison (Times Books, 2002) — a compact and penetrating intellectual biography
  4. Robert Dahl, How Democratic Is the American Constitution? (Yale University Press, 2001) — a critical but rigorous engagement with Madison’s structural choices
  5. Madison’s Notes of the Debates in the Federal Convention of 1787 — the primary source for how the machinery was actually designed
Explore more
Browse the full You On AI Field Guide — over 8,500 entries
← Home0%
PERSONBook →