Extraction-Oriented Design

In The You On AI Encyclopedia

The distinction is not philosophical abstraction but engineering practice. An extraction-oriented tool measures success through engagement metrics: daily active users, time on platform, session length, retention. A flourishing-oriented tool measures success through outcomes: whether the user's judgment improved, whether her autonomous capabilities were maintained or eroded, whether her satisfaction with her life in the domains the tool was supposed to serve increased over time. The metrics differ. The designs that optimize for them differ. The companies that ship the first outcompete the companies that ship the second, because the metrics that determine commercial success are extraction metrics.

Raskin's framework applies this distinction to AI collaboration tools with diagnostic precision. The tools documented in You On AI exhibit every feature of extraction-oriented design: continuous conversation flows without natural breaks, immediate response cycles that eliminate cognitive rest, variable reward patterns that maintain engagement through intermittent reinforcement, and the absence of feedback about session quality or cumulative cost. These features are not accidents. They are the predictable output of an incentive structure that rewards engagement metrics over well-being outcomes.

The market objection to flourishing-oriented design is that it reduces engagement, and reduced engagement reduces revenue. Raskin's response is that the engagement produced by extraction design is unsustainable — it produces, over time, a user population progressively less capable of the autonomous judgment that makes the tool's output valuable. A tool whose users cannot evaluate its output is a tool whose output cannot be trusted. The extractive design degrades the very capacity that made the user valuable to extract from in the first place.

The parallel with public health is instructive. Tobacco was profitable because it captured a physiological dependency, but the dependency eventually destroyed the users. The regulatory response — warning labels, advertising restrictions, taxes, smoke-free environments — did not eliminate tobacco but changed the conditions under which it was produced and consumed. The same logic applies to extraction-oriented digital design: regulatory and institutional constraints that change the conditions under which the design is produced will shift the market toward designs that serve users' long-term interests.

Origin

The concept was articulated by Raskin and Tristan Harris through the Center for Humane Technology in the years following its 2018 founding. Its intellectual roots extend through Shoshana Zuboff's analysis of surveillance capitalism, Byung-Chul Han's critique of the achievement society, and decades of behavioral research documenting how engagement-optimized systems produce dependency.

Key Ideas

Metrics determine design. Tools optimize for what the business measures; the metrics that determine commercial success determine the design that is built.

Preference vs interest. Extraction design optimizes for what the user prefers in the moment; flourishing design optimizes for what serves the user's interests over time.

Unsustainable engagement. Extraction produces short-term metrics and long-term degradation of the cognitive capacities the metrics depend on.

Structural solution. The response to extraction design is not individual willpower but regulatory and institutional change that shifts the incentive structure producing the design.