Secrecy and Algorithmic Opacity

In The You On AI Field Guide

At the first level, AI creates a new form of transparency — the capacity to detect patterns in behavior, communication, and expression at a scale that renders previously invisible structures visible. The system analyzing communication patterns within an organization identifies informal hierarchies, detects sentiment shifts, and maps workplace dynamics with a precision no human observer could achieve. The erosion of interiority is not experienced as surveillance in the traditional sense; there is no watcher, no observer. There is only a system operating automatically, processing information at scale.

At the second level, AI creates a new and structurally unprecedented form of secrecy: the opacity of the algorithm itself. The systems that render human behavior transparent are themselves profoundly opaque. The large language model operates according to principles inaccessible not merely to the individuals whose lives they affect but, in important respects, to the engineers who built them. This opacity is not the result of deliberate concealment but a structural property arising from the mathematical complexity of neural networks.

Traditional secrecy involves a secret-holder — a person or group possessing information and deliberately withholding it. The secret is something that could, in principle, be disclosed. Algorithmic opacity is categorically different. There is no secret-holder in any meaningful sense. The algorithm does not keep a secret. The algorithm is a secret — a form of opacity intrinsic to the technology rather than produced by social arrangements.

At the third level, the transformation affects the relationship between secrecy and trust. Trust, in Simmel's analysis, depends on a specific configuration: enough knowledge to make confidence reasonable, enough ignorance to make the trust meaningful. Trust resting on complete knowledge is not trust but verification. The employer who deploys AI to analyze employee communications discovers patterns of sentiment and undisclosed dissatisfactions that the employment relationship's tacit norms would have left unexamined. The increase in knowledge does not produce a corresponding increase in trust; it may produce the opposite.

Origin

Simmel's "Die Soziologie des Geheimnisses und der geheimen Gesellschaften" appeared in the American Journal of Sociology in 1906 — the first major Simmelian essay to appear in English — and was subsequently incorporated into the 1908 Soziologie.

The framework influenced generations of sociologists of privacy, secrecy, and surveillance. Its application to AI makes visible a power asymmetry that previous surveillance theories addressed only partially: the combination of unprecedented transparency for the subject with unprecedented opacity for the system that produces the transparency.

Key Ideas

Configurations of knowledge and ignorance. Every relationship is defined by a specific pattern of what is disclosed and what is withheld; the pattern constitutes the relationship's form.

Secrecy as achievement. The capacity to conceal creates the interiority on which individual autonomy depends; a world without secrecy is a world without inner life.

Algorithmic transparency as pattern detection. AI systems make the individual progressively more visible through inference from micro-behaviors, without any overt surveillance.

Opacity as structural property. Large language models are not deliberately concealed; they are intrinsically opaque, and no one — not even their builders — fully knows what they do.

The inversion of trust. Trust depends on the structured maintenance of a boundary between the known and the unknown; systems that dissolve this boundary erode trust even as they increase knowledge.