You On AI Field Guide · The Excoded The You On AI Field Guide Home
TxtLowMedHigh
CONCEPT

The Excoded

Joy Buolamwini’s term for the people harmed by algorithmic systems—wrong-arrested, loan-denied, hiring-filtered, rendered invisible—who fall on the wrong side of tools optimized for someone else, fusing exclusion with code to insist that algorithmic harm constitutes a class, not a series of isolated incidents.
The excoded are the people who experience the coded gaze not as an abstract structural condition but as concrete, consequential harm: wrongly arrested on the strength of a bad facial-recognition match, denied a loan by a scoring model, filtered out of a hiring pipeline, rendered invisible by a sensor never calibrated for their skin. Joy Buolamwini coined the word by fusing exclusion with code, and the fusion does deliberate political work. The technology industry prefers to discuss such harms one error at a time, treating each as an isolated bug to be patched: a false arrest becomes a regrettable individual case, a discriminatory denial becomes a customer-service matter. By naming the excoded as a group, Buolamwini resists this atomization. She points out that the same structural forces produce the same kinds of victims again and again, and that those victims are not randomly distributed. They cluster among the people the coded gaze never properly saw—the darker-skinned, the poor, the surveilled, the already marginalized—the people most likely to be harmed by the systems that fail them and most likely to be targeted by the systems that work. The concept has a deliberate echo of the language of civil rights, and Buolamwini means the echo to be heard: the protection of rights in the algorithmic age is itself a frontier of civil rights, and the excoded are the digital analogue of every group that has historically been denied full standing, except that the denial now arrives wrapped in the authority of mathematics, harder to contest precisely because it presents itself as objective. A human gatekeeper can be accused of prejudice. An algorithm offers no face to confront, only an output that claims to be a calculation. In the generative era, the category expands: the excoded are not only denied loans but denied accurate representation in the synthetic version of humanity that generative models produce—absent, stereotyped, or deformed in the world the machine imagines when asked to represent people like them.
The Excoded
The Excoded

In the [YOU] on AI Field Guide

The cycle’s argument is that capable machines press the human question to the surface—that understanding AI requires understanding what we owe one another in a world where the machinery of social sorting has been automated. The excoded are the people for whom the sorting has gone wrong, and Buolamwini insists that their experience is not peripheral to the cycle’s central questions but central to them: the question of who gets to be fully human in the world we are building is answered, in practice, by which faces the systems recognize, which voices they transcribe faithfully, which people’s existence they represent accurately in the synthetic culture they produce.

The excoded also constitute the cycle’s most direct answer to abstraction. It is easy to debate the AI transition as a question of capability and scale, of productivity and displacement, of governance and alignment. The excoded insists on the person at the other end of every deployed system—the specific individual who is sorted, scored, seen, or overlooked—and refuses the analytical operation that turns her into an acceptable error rate.

Origin

Buolamwini introduced the term in Unmasking AI (2023) alongside the coded gaze, treating the two as companion concepts: the coded gaze names the structural mechanism, the excoded names its human consequence. The pairing is methodologically consistent with her career—every empirical finding is given both a structural name and a human name, because both are necessary to produce accountability: the structural name for institutions to address, the human name for courts to protect.

The Gender Shades study that established the disparity in facial-analysis systems was the founding empirical case for the excoded, but Buolamwini was always explicit that the concept generalizes beyond faces to every algorithmic system that makes consequential decisions about people. Hiring algorithms, credit-scoring models, recidivism-prediction tools, healthcare triage systems—each produces its own population of excoded, and the populations overlap: the people most likely to be wrongly assessed by one system are typically the people most likely to be wrongly assessed by the others.

Key Ideas

Collectivizing the harm. The most important function of the term is to resist the industry’s atomization of algorithmic harm. Individual errors become isolated incidents; the excoded become a class. And a class can assert collective rights, demand systemic remedies, and exercise political pressure in ways that isolated individuals cannot. The naming is a political act as much as a descriptive one.

Double exposure. The excoded are not merely the people harmed by systems that fail them. They are also, disproportionately, the people targeted by systems that work. The community that is most likely to be misidentified by facial recognition is also the community most likely to be scanned by it. The worker whose résumé is most likely to be discarded by a hiring algorithm is also the worker who most needs algorithmic screening to work correctly. The harms compound at the intersection.

Invisibility of recourse. The excoded are vulnerable in a specific way: the harm is often invisible to them. They may never learn that a model rejected them, let alone why. Even where they do learn, the avenues of redress are thin—no appeal, no explanation, no human who will take responsibility. Buolamwini has been pointed about this gap: even significant AI policy falls short precisely on the questions of redress and consequence for companies whose systems harm real people.

Generative expansion. The generative turn expands the category beyond sorting and denial to representation and fabrication. A person who is consistently misrendered, stereotyped, or erased by the dominant generative systems is excoded in a new sense—not denied a service but denied accurate existence in the synthetic infrastructure through which culture is increasingly produced. The harm is more diffuse but no less real, and it falls along the same familiar lines.

Further Reading

  1. Joy Buolamwini, Unmasking AI: My Mission to Protect What Is Human in a World of Machines (Random House, 2023)
  2. Joy Buolamwini & Timnit Gebru, “Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification,” Proceedings of Machine Learning Research (2018)
  3. Virginia Eubanks, Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor (St. Martin’s Press, 2018)
  4. Safiya Umoja Noble, Algorithms of Oppression: How Search Engines Reinforce Racism (NYU Press, 2018)
Explore more
Browse the full You On AI Field Guide — over 8,500 entries
← Home0%
CONCEPTBook →