TECHNOLOGY
The Skinner Box
The operant conditioning chamber Skinner invented in the 1930s — and the device whose contingency architecture, Harvard's Kempner Institute observed, is structurally identical to the reinforcement learning procedure that produced ChatGPT.
The operant conditioning chamber — widely known as the Skinner box — is the experimental apparatus Skinner designed to study operant behavior under controlled conditions. A small enclosed chamber contains a manipulandum (lever for rats, key for pigeons) and a reinforcement delivery mechanism (food hopper, water dispenser). The organism's responses are recorded automatically; reinforcement is delivered according to programmed schedules; extraneous variables are minimized. The device made possible the systematic parametric investigation of schedule effects that became the foundation of operant science, and its design logic — automated contingency delivery to a responding organism — has been explicitly recognized as the structural template for reinforcement learning from human feedback, the training procedure that shaped GPT-3 into ChatGPT.
In The You On AI Field Guide
The apparatus was developed through iterative refinement during Skinner's graduate work at Harvard in the early 1930s. The goal was an experimental preparation that isolated operant behavior from the complications of maze-running and discrete-trial procedures, allowing continuous