The May 2023 federal court case in which a New York attorney filed a brief containing six entirely fabricated judicial citations generated by ChatGPT — the visible edge of the AI comprehension gap, caught only because the failure mode was binary rather than marginal.
In May 2023, New York attorney Steven Schwartz filed a legal brief in the federal case Mata v. Avianca citing six judicial decisions. The citations were formatted correctly, the case names were plausible, and the holdings were stated with the confident specificity that a judge expects. None of the cases existed. Schwartz had used ChatGPT to conduct the research, and the model had generated fictitious citations — cases that sounded real, with holdings that supported the argument, but with no existence in any court's records. Opposing counsel checked the citations, found nothing, and brought the fabrication to the court's attention. Judge P. Kevin Castel sanctioned Schwartz and his firm, and the incident traveled through the legal profession with the speed of genuine alarm.
The Schwartz Incident
In The You On AI Field Guide
The incident is instructive not because it is typical but because it is the visible edge of a phenomenon