operant conditioning

- learning that occurs based on the consequences of behavior

2

Edward L. Thorndike

- the first scientist to systematically study operant conditioning

3

law of effect

- the principle that responses that create a typically pleasant outcome in a particular situation are more likely to occur again in a similar situation, whereas responses that produce a typically unpleasant outcome are less likely to occur again in the situation

4

Skinner box (operant chamber)

- a structure that is big enough to fit a rodent or bird and that contains a bar or key that the organism can press or peck to release food or water. It also contains a device to record the animal’s responses

5

reinforcer

- any event that strengthens or increases the likelihood of a behavior

6

punisher

- any event that weakens or decreases the likelihood of a behavior

7

positive reinforcement

- strengthens a response by presenting something pleasant after the response

8

negative reinforcement

- strengthens a response by reducing or removing something unpleasant

9

punishment

- any event that weakens or reduces the likelihood of a behavior

10

positive punishment

- weakens a response by presenting something unpleasant after the response

11

negative punishment

- weakens a response by reducing or removing something pleasant

12

continuous reinforcement schedule

- the desired response is reinforced every time it occurs

13

partial (or intermittent) reinforcement schedule

- a schedule in which the responses are sometimes reinforced, and sometimes not

14

fixed-interval schedule

- reinforcement occurs for the first response made after a specific amount of time has passed

15

variable-interval schedule

- the reinforcers appear on an interval schedule, but the timing is varied around the average interval, making the actual appearance of the reinforcer unpredictable

16

fixed-ratio schedule

- a behavior is reinforced after a specific number of responses

17

variable-ratio schedule

- provides reinforcers after a specific but average number of responses

18

shaping

- the process of guiding an organism’s behavior to the desired outcome through the use of successive approximation to a final desired behavior

19

primary reinforcer

- stimuli that are naturally preferred or enjoyed by the organism, such as food, water, and relief from pain

20

secondary reinforcer

- neutral event that has become associated with a primary reinforcer through classical conditioning