CONCEPT
The Felicific Calculus
Jeremy Bentham's eighteenth-century proposal to measure pleasure and pain along seven quantitative dimensions and maximize the resulting sum—the direct ancestor of every reward function, objective function, and welfare metric in modern artificial intelligence.
The felicific calculus is the most consequential thought experiment in the history of moral philosophy, and it is no longer a thought experiment. Jeremy Bentham proposed, in
An Introduction to the Principles of Morals and Legislation (1789), that any pleasure or pain could be assessed along seven dimensions—intensity, duration, certainty, propinquity, fecundity, purity, and extent—and that the right action was whichever produced the greatest total. This is, structurally, an objective function, and every
large language model fine-tuned by reinforcement learning from human feedback, every recommender system optimizing engagement, every algorithmic welfare allocation is running a version of it. The calculus that Bentham could only describe in prose has been implemented at a scale he could only fantasize about, and the implementation has exposed, at last, the flaw he sensed but could never demonstrate: that the measurable proxy and the valued thing diverge under optimization pressure, a phenomenon now formalized as
Goodhart's Law. Bentham's calculus assumed that pleasure and pain were scalars—that