CONCEPT
The Training Corpus as Fossil Record
The accumulated output of human civilization reframed through Tarde's lens — not as a dataset but as the sedimented layer of billions of prior imitative acts, each one a modification transmitting patterns onward.
The corpus on which a large language model is trained is not, strictly speaking, a dataset. It is the sedimented output of several thousand years of human imitative activity, compressed into a form that a machine can process. Every text in the corpus is itself a product of imitation — the scientific paper imitating disciplinary conventions, the novel imitating genre traditions, the email imitating professional communication norms. Each text was produced by a mind that had received patterns from prior texts and reproduced them with modifications reflecting that mind's specific position in the network. The corpus as a whole is the geological column — the accumulated record of billions of imitative acts, each one a layer of sediment deposited by a specific moment in the continuous movement of beliefs, desires, and cultural forms through the human network. Tarde would have recognized the corpus for what it is: a fossil record of the imitative flow.
