You On AI Field Guide · The Non-Identity Problem The You On AI Field Guide Home
TxtLowMedHigh
CONCEPT

The Non-Identity Problem

Derek Parfit’s most consequential discovery: that the choices which most powerfully shape the welfare of future generations also determine which future people exist, so that ordinary harm-based ethics loses its grip exactly where the stakes of AI development are highest.
Ordinary ethics rests on a simple foundation: an act is wrong if it makes someone worse off than they would otherwise have been. The non-identity problem is Derek Parfit’s proof that this foundation collapses when applied to large-scale choices about the future. Consider two policies—Depletion and Conservation—that produce not merely different outcomes for the same future people but different future people entirely: different conceptions, different births, different individuals whose very existence depends on which policy was chosen. The people who live in the depleted world cannot say they were harmed by the choice, because the only alternative for them was never to exist; and a life that is difficult but worth living is not worse than non-existence by any standard the person inside can apply. The ordinary harm-based argument evaporates. The intuition that something deeply wrong was done survives. The gap between the intuition and the framework is the non-identity problem, and it is the
← Home0%
CONCEPTBook →

Keep reading with YOU ON AI

Unlock the full book, 10,000+ field-guide entries, and a 1000+ thinker library. If you have a book code, register now — it takes a minute.

Register with book code Sign in