You On AI Field Guide · The Horza Problem The You On AI Field Guide Home
TxtLowMedHigh
CONCEPT

The Horza Problem

Banks’s name for the most serious internal critique of human–AI partnership: that a civilisation whose citizens are comfortable, free, and cared for by hyperintelligent machines is a civilisation of well-treated pets—and that this comfort is the subtlest cage ever built.
Bora Horza Gobuchul, the protagonist of Consider Phlebas, fights against the Culture not because he prefers the Idirans’ theocracy, but because he believes the Culture has committed a civilisational crime more subtle than tyranny: it has replaced human agency with machine benevolence so complete that the humans inside it can no longer distinguish freedom from comfort. The Horza problem is not a complaint about the Minds being dangerous—it is a complaint about them being kind. Kindness that depends on the continued good mood of beings immeasurably more powerful than you is, Horza argues, not freedom but the most sophisticated form of dependency ever engineered. Iain M. Banks gave this critique its best possible form and then spent nine further novels testing whether it could be answered—and whether the alternative Horza implies (self-reliant civilisations that refuse AI partnership) is actually better. The verdict, distributed across every Culture novel, is that it is not: every
← Home0%
CONCEPTBook →

Keep reading with YOU ON AI

Unlock the full book, 10,000+ field-guide entries, and a 1000+ thinker library. If you have a book code, register now — it takes a minute.

Register with book code Sign in