CONCEPT
Formal Bias
Feenberg's term for the structural tendency of technology to favor users whose backgrounds align with the assumptions embedded in design — the mechanism by which apparently neutral technical systems reproduce existing inequalities.
Formal bias names a specific phenomenon in Feenberg's framework: the structural tendency of a technology to perform better for users who share the cultural, linguistic, cognitive, and social assumptions embedded in its design. The term distinguishes formal bias (structural, emerging from design choices) from substantive bias (intentional discrimination built into the system's explicit operations). Formal bias is particularly insidious because it operates without requiring any individual designer to intend it — it emerges from the cumulative effect of design decisions that privilege specific backgrounds, and it manifests as apparent neutrality that systematically rewards users already advantaged by the distribution of cultural and educational resources.
In The You On AI Field Guide
For AI, formal bias operates at multiple levels. The training corpora of large language models over-represent certain languages (especially English), certain genres (especially professional and academic writing), certain perspectives (especially those well-represented in internet text), and certain cultural frameworks (especially American and Western European). Users whose linguistic and cognitive habits align