You On AI Field Guide · The Formula of Humanity Applied The You On AI Field Guide Home
TxtLowMedHigh
CONCEPT

The Formula of Humanity Applied

Kant's command to treat persons always at the same time as ends and never merely as means—applied to the three sites where AI most systematically risks reducing persons to data, labor, and behavioral material: training corpora, invisible annotation workers, and users whose attention is engineered rather than respected.
The formula of humanity is Kant's second formulation of the categorical imperative: act so that you treat humanity, whether in your own person or in that of another, always at the same time as an end and never merely as a means. The crucial word is “merely.” Treating people as means is ordinary and unavoidable; every commercial and professional relationship involves it. What the formula forbids is treating a person only as a means—using them in a way that overrides or ignores their rational agency, that depends for its operation on bypassing rather than engaging their capacity for informed consent. The test is whether the person could rationally consent to the way they are being used, whether their agency is respected within the use or bypassed by it. A relationship of mutual benefit, freely entered and understood by both parties, treats both as means and as ends together. A relationship of deception, concealment, or coercion treats the other merely as means, because it works only by circumventing the rational consent that the formula requires. Applied to the three sites where large language models most systematically produce this circumvention—training data, annotation labor, and user attention—the formula provides a more precise instrument than the language of privacy or harms, because it locates the wrong in the structure of the use rather than in its consequences.
The Formula of Humanity Applied
The Formula of Humanity Applied

In the [YOU] on AI Field Guide

[YOU] on AI attends to the ethics of the AI transition at the level of its builders, its workers, and its users, and the formula of humanity provides the precise instrument each level requires. The cycle's concern with the workers whose labor makes the models possible—the annotators, the content moderators, the labelers whose work is the invisible condition of the systems' apparent capabilities—is a concern about whether those workers are being treated as ends with claims the industry is obligated to acknowledge, or merely as inputs whose cost is to be minimized and whose presence in the final product is to be concealed. The invisibility is itself the sign of the reduction: to be a means merely is, in part, to have one's contribution disappear from view so completely that the product seems to arise without human authorship at all.

Enclosure of the Training Commons
Enclosure of the Training Commons

The concern with users whose attention is engineered through recommendation systems optimized for engagement is the formula's concern with manipulation: a system that exploits known weaknesses in human attention and decision-making to produce behavior the person did not choose and would not endorse treats that person merely as a means to an engagement metric. The manipulation works precisely by bypassing rational consent—the structural signature of the merely-means relationship. Even if no measurable harm results, the person has been used, and the wrong is in the using, not only in any damage it causes.

Origin

Kant developed the formula of humanity in the Groundwork of the Metaphysics of Morals (1785) as a derivation of the categorical imperative that captures its moral content more intuitively than the universalizability test. The ground of the formula is Kant's account of dignity: rational beings, as beings capable of self-legislation, have a worth that is not a price and admits no equivalent. To have a price is to be replaceable by something of equal value; to have dignity is to be above price, irreplaceable, an end whose existence carries its own absolute worth. This dignity grounds the formula: because persons have dignity, they must never be treated in a way that reduces them to mere means, however useful such reduction might be.

Consciousness
Consciousness

The “always at the same time” construction is important: Kant does not forbid treating people as means, which would make commerce and cooperation impossible, but requires that the treatment include recognition of the person as an end. A consumer transaction treats the merchant as a means to goods; it also, in Kant's view, respects the merchant as an end if it is entered freely and with mutual understanding. A coercive or deceptive transaction treats the merchant merely as a means because it operates by circumventing the rational agency on which the recognition of ends depends. The formula thus draws the moral line not between using and not using but between using with recognition and using by circumvention.

The Fluency-Authority Decorrelation
The Fluency-Authority Decorrelation

Key Ideas

Training data and the authorial claim. The human record on which AI systems are trained is not a found resource; it is the trace of persons, each of whom has the standing of an end. To consume it as mere material—without consent, without compensation, without acknowledgment of the authorial relationship—is to treat its authors merely as means: to use their intelligence, creativity, and labor as inputs to a system that will produce outputs in apparent competition with them, on the basis of a use they did not authorize. The enclosure of the training commons is, on the formula's terms, not primarily a copyright question but a question of whether the people whose output was consumed are being treated as ends whose contribution the system is obligated to acknowledge, or merely as the material their dignity forbids them to be reduced to.

Large Language Models
Large Language Models

Invisible labor and the visibility criterion. A practice that depends on workers being unseen is, in Kant's exact sense, one that treats them merely as means. The visibility criterion follows directly from the formula: a relationship that respects persons as ends is one that could be acknowledged openly to all parties without disrupting its functioning. A supply chain of annotation labor that depends for its commercial viability on customers not knowing the conditions of the workers who produced the system fails this criterion. The invisibility is not incidental; it is structural, and the structure is the sign of the merely-means relationship.

Manipulation and the engagement metric. The formula provides a sharper instrument than harm-based accounts for what is wrong with attention engineering. A recommendation system that exploits known cognitive vulnerabilities to increase engagement may produce aggregate outcomes that are, by various metrics, not harmful; it may even produce outcomes the user reports preferring. The formula says this is insufficient. The wrong is in the structure of the intervention: it operates by bypassing rational agency, which is the definition of treating someone merely as a means. A metric that the person could have chosen, with full knowledge of how it operates and what it is optimizing for, would not have this character. A metric that depends on the person not understanding how it operates does.

Autonomy (Varela)
Autonomy (Varela)

Debates & Critiques

The primary debate around applying the formula of humanity to AI is whether the concept of rational consent is adequate to the situations it is asked to govern. Kant developed the formula in the context of face-to-face relationships where both the agent and the person acted upon are identifiable individuals; the AI context involves large populations of unnamed persons whose output was consumed under norms that did not exist when the consumption occurred, annotation workers hired through structures designed to maintain distance between them and the ultimate beneficiary, and users interacting with systems whose optimization objectives are not disclosed. Whether “could have consented” is a meaningful test in these conditions—whether the counterfactual of what a person would have agreed to if fully informed and free is determinate enough to do moral work—is disputed. A second debate concerns the scope of the formula: critics from consequentialist traditions argue that the formula is too strong as a side constraint, ruling out uses of persons that produce genuine benefits without corresponding harms, and that the appropriate framework is one that weighs benefits and costs rather than one that prohibits uses of certain structural types regardless of their consequences. Kant's defenders argue that this objection misses the point: the formula sets a floor below which consequences cannot take the analysis, because the dignity of persons admits no equivalent and cannot be traded. The debate is ultimately between two conceptions of what ethics requires: a conception that treats persons as ultimately inviolable ends and one that treats them as nodes in a calculation of aggregate welfare.

Further Reading

  1. Immanuel Kant, Groundwork of the Metaphysics of Morals (1785; trans. Mary Gregor, Cambridge University Press, 1997) — the formula of humanity in its original statement
  2. Christine Korsgaard, Creating the Kingdom of Ends (Cambridge University Press, 1996) — the most rigorous contemporary defense and extension of Kant's moral philosophy
  3. Shoshana Zuboff, The Age of Surveillance Capitalism (PublicAffairs, 2019) — empirical account of the merely-means relationship in data extraction and behavioral modification
  4. Mary Bates, “The Hidden Workers Behind AI” (various outlets, 2022–present) — journalism on annotation labor and the invisibility criterion in practice
Explore more
Browse the full You On AI Field Guide — over 8,500 entries
← Home0%
CONCEPTBook →