The Schwartz Incident
In May 2023, New York attorney Steven Schwartz filed a legal brief in the federal case Mata v. Avianca citing six judicial decisions. The citations were formatted correctly, the case names were plausible, and the holdings were stated with the confident specificity that a judge expects. None of the cases existed. Schwartz had used ChatGPT to conduct the research, and the model had generated fictitious citations — cases that sounded real, with holdings that supported the argument, but with no existence in any court's records. Opposing counsel checked the citations, found nothing, and brought the fabrication to the court's attention. Judge P. Kevin Castel sanctioned Schwartz and his firm, and the incident traveled through the legal profession with the speed of genuine alarm.
The Material Infrastructure Reading — Contrarian ^ Opus
There is a parallel reading that begins not from comprehension gaps but from the material conditions of AI deployment. The Schwartz Incident reveals less about epistemic degradation than about the economic pressures reshaping legal practice. Schwartz was not a Wall Street lawyer with unlimited research resources but a personal injury attorney in Queens, operating under the economic constraints that define most legal work. ChatGPT offered what Westlaw and LexisNexis price out of reach for small firms: seemingly comprehensive legal research for free. The fabricated citations were not a failure of comprehension standards but a predictable outcome when professional infrastructure becomes luxury goods accessible only to well-capitalized firms.
The incident's aftermath reinforces rather than resolves this stratification. The bar associations' guidance to "verify all AI-generated citations" assumes access to the very databases whose expense drove Schwartz to ChatGPT in the first place. Large firms respond by licensing specialized legal AI tools with built-in verification — Westlaw's Co-Counsel, Lexis+ AI — that cost more than many solo practitioners gross in a month. The comprehension gap Edo identifies is real, but it maps precisely onto existing economic fault lines. Those with resources maintain comprehension through expensive tooling and armies of associates; those without must choose between unaffordable thoroughness and dangerous shortcuts. The Schwartz Incident thus becomes a morality tale that obscures the deeper story: AI accelerates the commodification of legal knowledge, transforming what was once a public good maintained through professional norms into a tiered service where comprehension itself becomes a premium product. The lawyers who will drift from comprehension are not those seduced by AI's fluency but those priced out of maintaining professional standards.
In the AI Story
The incident is instructive not because it is typical but because it is the visible edge of a phenomenon that is usually invisible. The fabricated citations were caught because they did not exist — the failure mode was binary, detectable through straightforward verification that anyone could perform.
The more consequential gap between competence and comprehension produces failures that are not fabrications but distortions: real citations misrepresented in subtle ways, real cases cited without the qualifications that reshape their meaning, real arguments structured in ways that overlook the counter-arguments a thorough reader would have anticipated. These failures are not caught by verification; they are caught only by the practitioner who has read the cases with the depth the formal standard of legal practice requires.
The Schwartz incident operates in Vaughan's framework as an inverse demonstration. The failure was detected because Schwartz's reliance on the tool produced a binary error the existing verification processes could catch. A lawyer who used the tool more competently — who checked that cited cases existed but did not read them with the depth that would reveal the subtle distinctions, qualifications, and counter-arguments — would produce outputs that pass every verification check while occupying the comprehension gap the formal standard of practice was designed to prevent.
The incident produced a wave of bar association guidance, firm policies, and technology vendor disclaimers addressing AI-fabricated citations. None of this guidance addresses the deeper gap. The policies require that citations be verified; they do not require that cases be read. The comprehension gap persists in the practice even as the binary failure mode has been largely eliminated.
Origin
The case was Mata v. Avianca, Inc., filed in the Southern District of New York. The sanction order was issued by Judge P. Kevin Castel on June 22, 2023. Schwartz and his firm were fined $5,000. The incident was widely covered in legal and technology press and became a standard reference in discussions of AI use in professional practice.
Key Ideas
Binary failure caught. The citations were fabrications; verification caught them because the cases did not exist at all.
Marginal failure survives. Outputs that cite real cases but misrepresent their meaning pass verification while occupying the comprehension gap.
Policy response insufficient. Bar guidance requires citation verification but does not require reading; the gap persists in practice.
Visible edge of invisible phenomenon. Most AI-era comprehension failures are not binary and will not be caught by the mechanisms that caught Schwartz.
Reinforcement of normalization. The attention paid to binary fabrications may paradoxically reinforce the sense that verified outputs are trustworthy, accelerating the drift in comprehension standards.
Appears in the Orange Pill Cycle
Comprehension as Economic Good — Arbitrator ^ Opus
The question of what the Schwartz Incident reveals depends entirely on which layer of the phenomenon we examine. At the individual practitioner level, Edo's framing dominates (90/10): Schwartz's failure to verify was indeed a comprehension gap, a drift from professional standards that the tool's fluency enabled. The fabricated citations represent exactly the kind of epistemic degradation that occurs when outputs feel trustworthy enough to bypass the verification habits that maintain professional competence. Here, the incident functions precisely as Edo suggests — as the visible edge of a broader pattern of marginal degradation.
But shift the question from individual practice to systemic conditions, and the contrarian view gains ground (70/30). The economic pressures that led Schwartz to ChatGPT are not incidental but structural. The legal research infrastructure has become increasingly expensive, with Westlaw and LexisNexis operating as effective oligopolies. When we ask why practitioners turn to AI tools, the answer involves not just the seduction of fluency but the practical impossibility of maintaining traditional research standards under contemporary economic constraints. The comprehension gap becomes inseparable from an access gap.
The synthesis emerges when we recognize that comprehension itself has become stratified. The Schwartz Incident reveals both an epistemic problem (the gap between competence and comprehension) and an economic one (the transformation of comprehension into a scarce good). The proper frame is neither purely cognitive nor purely material but recognizes how economic pressures create the conditions for epistemic degradation. The lawyers most likely to occupy the comprehension gap are not those fooled by AI's fluency but those forced by economic necessity to accept it. The incident thus marks not just a shift in professional standards but their fracturing along economic lines — a process AI accelerates but did not create.
Further reading
- Mata v. Avianca, Inc., Order of June 22, 2023 (S.D.N.Y.)
- Benjamin Weiser, "Here's What Happens When Your Lawyer Uses ChatGPT" (New York Times, May 27, 2023)
- Diane Vaughan, The Challenger Launch Decision (1996)