The COMPAS Case

In The You On AI Field Guide

The case's pedagogical power lies in its refusal of the analytical frame that AI ethics discourse has privileged. Most bias cases end with the identification of bias. The COMPAS case begins there. Students are told what was wrong; they are asked to construct the specific intervention that could have changed the outcome. The shift from the first question to the second changes what counts as student work. The analytical case rewards eloquence about principles. The scripting case rewards specific sentences, specific stakeholder analyses, specific anticipated objections, and specific responses.

The case surfaces the distinction between culpable and constrained silence with unusual clarity. Northpointe's data scientists had access to the outputs ProPublica would eventually analyze. Some may not have examined the outputs by demographic category — a failure of attention rather than voice. Some may have noticed and dismissed the patterns as noise — a failure of interpretation. Some may have noticed, understood, and remained silent because they lacked the institutional channels, the organizational safety, or the prepared scripts to raise the concern effectively. For the third group, the silence is structural rather than characterological, and the case forces students to confront what the organization would have had to provide for the concern to become voice.

Brennan himself functions in the case as neither villain nor hero but as a professional who had genuine ethical motivations — reducing human bias in the criminal justice system — and who did not develop the organizational mechanisms that would have allowed concerns raised by his own team to surface and influence design decisions. The case treats this as a failure of institutional architecture, not of character, which is the signature Gentile move. Students are asked to redesign Northpointe so that the pattern would have been caught before ProPublica caught it — a redesign exercise that exposes the specific structural conditions ethical voice requires.

The case has been taught in more than 200 settings documented in the GVV pilots, including law school courses on criminal procedure, business school courses on AI strategy, and technical courses on machine learning. Its portability across contexts reflects a feature Gentile has often emphasized: the structural conditions for ethical voice are more consistent than the particular content of the ethical concern. The COMPAS scripts students develop in a computer science seminar closely resemble those developed in a legal ethics course, because the organizational dynamics of silence are similar across professions.

Origin

Gentile developed the case with Adriana Krasniansky during Krasniansky's time as a research associate at Darden. The collaboration was deliberately interdisciplinary: Krasniansky had technical training, Gentile had the pedagogical methodology, and the case was piloted in both technical and business school settings to ensure it worked for audiences with and without machine-learning background. The first published version appeared in 2020; the case has been updated twice to incorporate subsequent developments in AI regulation.

Key Ideas

The case reframes the ethics question from analysis to performance. Students are told bias exists and asked what to say about it, not whether to call it bias.

It surfaces the structural layer of silence. Not everyone silent at Northpointe was equally positioned to speak. The case forces students to distinguish between failures of attention, interpretation, and institutional support.

The redesign exercise is central. Students propose organizational mechanisms — reporting channels, review processes, peer networks — that would have made voice possible.

The case's portability reflects a deeper pattern. Structural conditions for voice travel more reliably across professional contexts than the content of the ethical concern itself.

Brennan is presented as a professional, not a moral failure. The case refuses the villain frame in order to expose the institutional design problem.