CONCEPT
Operant Conditioning
Skinner's framework for how behavior is selected and maintained by its environmental consequences — the three-term contingency of discriminative stimulus, operant response, and reinforcing consequence that underwrites every schedule effect this book analyzes.
Operant conditioning is B.F. Skinner's account of how voluntary behavior is shaped and maintained by its consequences rather than by internal mental states. A response that produces a reinforcing consequence in the presence of a discriminative stimulus becomes more probable in that stimulus context; a response that produces punishment or the removal of reinforcement becomes less probable. The unit of analysis is the three-term contingency — stimulus, response, consequence — and every complex behavioral pattern, from a pigeon pecking a key to a programmer prompting Claude at three in the morning, decomposes into chains and schedules of this atomic unit. The framework's power lies in its predictive specificity: given a schedule's parameters, the behavioral trajectory can be forecast with a precision that folk-psychological vocabularies cannot match.
In The You On AI Field Guide
The conceptual architecture of operant conditioning emerged from Skinner's experimental work in the 1930s, first presented systematically in The Behavior of Organisms (1938) and developed across Science and