Psychology › Learning & behavior
Operant conditioning
1938· Theory or model
Well replicatedStrong, repeated evidence.
Learning from consequences: rewarded behavior becomes more frequent, punished or ignored behavior less, as B. F. Skinner formalized.
See it on the Psychology map →What it says
In The Behavior of Organisms (1938), Skinner separated this 'operant' learning, voluntary actions that operate on the world, from Pavlov's reflex-based conditioning. In his operant chamber, the 'Skinner box', a rat pressed a lever or a pigeon pecked a key for food while a recorder logged every response over time. By rewarding closer and closer approximations, called shaping, he trained pigeons to turn circles and even play a form of ping-pong. The rules hold broadly across species, humans included.
Why it matters
It is one of psychology's most practical findings, behind animal training, classroom token systems, addiction treatment, workplace incentives and the reward loops of games and apps.
The evidence
Status: well replicated. Decades of lab data from rats, pigeons, monkeys and people. Its limits are known too: biology makes some links far easier to learn, as 1960s taste-aversion studies showed.
Open questions
How much complex human behavior, such as language or creativity, reinforcement alone can explain; most psychologists say far less than Skinner claimed.
Inside this (6)
Connections (7)
▸Operant conditioning extended BehaviorismWell replicated
The connection
Early behaviorism leaned on Pavlov's reflexes, which explain responses triggered by signals but not new voluntary actions. Skinner's operant conditioning added learning from consequences: actions that pay off are repeated. That let behaviorism explain how animals and people acquire new behaviors, and his 'radical behaviorism' became the school's best-known form in the 1950s and 1960s.
Who showed it and when
Harvard University and Midwestern universities, 1930s–1950s; Skinner's The Behavior of Organisms (1938) and Science and Human Behavior (1953), which applied it to society.
The evidence
Skinner's books and the Journal of the Experimental Analysis of Behavior, founded in 1958, show operant work becoming behaviorism's main research program.
Open questions
Whether operant and classical conditioning are truly separate processes or two faces of one learning system is still debated by learning researchers.
▸Thorndike's law of effect laid the groundwork for Operant conditioningWell replicated
The connection
Thorndike's cats escaping puzzle boxes showed actions are 'stamped in' by satisfying results. Skinner took the same principle and made it precise: instead of timing single escapes, his chamber let an animal respond freely while every response was counted, revealing how the rate of behavior tracks its consequences.
Who showed it and when
Thorndike at Harvard and Columbia, 1896–1911; Skinner at Harvard from 1928, publishing his system in 1938.
The evidence
Skinner credited the law of effect in his own writings, and historians routinely trace operant conditioning back to Thorndike's puzzle boxes.
Open questions
How much Skinner added beyond Thorndike: some see a new science of response rates, others mainly better tools and a new vocabulary.
▸B. F. Skinner developed Operant conditioningWell replicated
The connection
Skinner coined the term 'operant' and built the tools to study it: the operant chamber, where an animal could respond freely, and the cumulative recorder, which drew a running line of responses over time. He showed how shaping, schedules and extinction control behavior, then applied the principles to teaching machines and society.
Who showed it and when
Harvard (PhD 1931), the University of Minnesota and Indiana University in the 1930s–40s, and Harvard again from 1948.
The evidence
His 1938 book and the cumulative records it reports, replicated in labs worldwide for decades; he disliked the nickname 'Skinner box' that others gave his chamber.
Open questions
Whether refusing to discuss inner mental states was a strength or a blind spot; Edward Tolman's rats showed animals form expectations and mental maps.
▸Reinforcement and punishment is the engine of Operant conditioningWell replicated
The connection
Operant conditioning runs on consequences. Reinforcement increases how often a behavior occurs; punishment, or simply no reward, decreases it. Skinner defined these terms purely by effect: something counts as a reinforcer only if it actually strengthens behavior, whatever anyone intended. A bonus nobody values reinforces nothing.
Who showed it and when
Formalized in Skinner's labs at Harvard and Minnesota, 1930s–1950s, building on Thorndike's work and borrowing the word 'reinforcement' from translations of Pavlov.
The evidence
Countless experiments that change rewards and measure response rates; the same patterns appear in classrooms, clinics and workplaces.
Open questions
Why some rewards undermine motivation, and what reliably reinforces humans: praise, money, attention and even information can all work, but not predictably.
▸Learned helplessness emerged from experiments in Operant conditioningWell replicated
The connection
Learned helplessness turned up unexpectedly in escape-learning experiments. Researchers testing how earlier shocks affected later escape training found that dogs that had faced uncontrollable shocks failed to learn the escape at all. It showed operant learning depends on the animal's sense that its actions affect outcomes, not just on rewards and punishments.
Who showed it and when
Richard Solomon's lab at the University of Pennsylvania, 1965–1967: Bruce Overmier and Martin Seligman, then Seligman and Steven Maier.
The evidence
Their 1967 'yoked' design gave paired dogs identical shocks, with or without control; only lack of control produced passivity, later replicated in rats and people.
Open questions
The dog studies raised animal-welfare concerns, and the 2016 brain-based reversal of the theory, drawn mostly from rat experiments, is still being tested in people.
▸Habits and habit formation are shaped by Operant conditioningWell replicated
The connection
Habits start as operant learning: an action in a setting earns a reward and gets repeated. With enough repetition in the same context, the cue alone triggers the action, even if the reward no longer matters. Researchers test this by devaluing the reward: habitual rats keep pressing the lever, goal-driven ones stop.
Who showed it and when
Christopher Adams and Anthony Dickinson's rat studies at Cambridge in 1981 set the test; Ann Graybiel at MIT traced habit circuits in the striatum from the 1990s.
The evidence
Devaluation experiments in rats, lesion studies showing separate goal and habit circuits, and human field studies by Wendy Wood linking stable settings to automatic behavior.
Open questions
Whether people form truly reward-independent habits as rats do; several careful human lab attempts since 2018 failed to produce them.
▸Applied behavior analysis (ABA) applies Operant conditioningWell replicated
The connection
ABA turns Skinner's lab principles into therapy. A target behavior is defined and measured, broken into steps and reinforced with praise, toys or tokens; prompts fade as skills grow. Problem behaviors are analyzed for what they get the person, such as attention or escape from a task, and that need is then met in better ways.
Who showed it and when
University of Washington and University of Kansas in the 1960s; Ivar Lovaas at UCLA from the 1960s; the Journal of Applied Behavior Analysis, launched in 1968.
The evidence
Its founding papers explicitly apply operant principles, and its core methods, such as Brian Iwata's 1982 'functional analysis', are defined in operant terms.
Open questions
Whether gains come from the operant techniques themselves or from intensive one-on-one attention, and which components matter most.