Slide 1ReinforcementThorndike’s Law of EffectSlide 4The Law of EffectHistory of Operant LearningSlide 7Operant LearningDiscrete Trial and Free Operant ProceduresTypes of Operant LearningReinforcement:Reinforcer:ReinforcementTwo types of reinforcementFunctional Definition of ReinforcementEffects of Reinforcement on BehaviorPositive ReinforcementNegative ReinforcementSlide 19Everyday Examples of Negative ReinforcementPositive and Negative Reinforcement in the Same SituationPositive and Negative Reinforcement in the Same SituationPrimary vs Secondary ReinforcersClicker Training – Conditioned ReinforcerConditioned / Generalized ReinforcersNatural vs Contrived ReinforcersPavlov vs SkinnerShapingUsing ShapingUsing ShapingSlide 31Slide 32Slide 33Using ShapingWhen is Shaping Used?When is Shaping Used?When is Shaping Used?When is Shaping Used?When is Shaping Used?Shaping Lever PressingExamples of ShapingBehavioral ChainBehavioral ChainStimulus-Response ChainTotal Task PresentationForward ChainingBackward ChainingSlide 48ContingencySlide 50ContiguitySlide 52Slide 53Reinforcer CharacteristicsTask CharacteristicsMotivating OperationsSlide 57Neuromechanics of ReinforcementNeuromechanics of ReinforcementNeuromechanics of ReinforcementLatent learningExtinction of Reinforced BehaviorSlide 63Extinction BurstIncrease in variabilityIncrease in frequency of emotional behaviorsSpontaneous RecoveryResurgenceRate of ExtinctionSlide 70Slide 71Slide 72Theories of ReinforcementTheories of ReinforcementTheories of ReinforcementTheories of AvoidanceSlide 77Sidman Avoidance ProcedureTheories of AvoidanceChapter 5ReinforcementClick on the picture of an example of the use of reinforcement on the show “Big Bang Theory”ReinforcementThorndike’s Law of EffectIn the late 1800’s people believed that higher animals learned via reasoningIn the late 1800’s people believed that higher animals learned via reasoningThorndike studied animal intelligence by systematically examining animal learningThorndike studied animal intelligence by systematically examining animal learning•Presented animals with problems to solve•Examined the change in behavior over many trialsWatch this video to see Thorndike’s Law of Effect in ActionLearning and Behavior, Sixth Edition by Paul ChanceCopyright © 2009 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.The Law of EffectDescribes the relationship between the behavior and the consequences of that behaviorDescribes the relationship between the behavior and the consequences of that behaviorHistory of Operant LearningSkinner built on Thorndike’s work in 1930’sDeveloped a chamber that demonstrated how behavior is a function of its consequencesNow referred to as Operant LearningClick image to see in actionAn introduction to Operant ConditioningOperant LearningBehavior that is strengthened through the process of reinforcementBehavior that is strengthened through the process of reinforcementType of learning in which a change in behavior is dependent upon the consequences of behaviorType of learning in which a change in behavior is dependent upon the consequences of behaviorDiscrete Trial and Free Operant ProceduresDiscrete Trials Free OperantTypes of Operant LearningLearning and Behavior, Sixth Edition by Paul ChanceCopyright © 2009 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.Reinforcement:An experience that increases the strength of a behavior due to its consequences (stimulus or event)An experience that increases the strength of a behavior due to its consequences (stimulus or event)Reinforcer:Consequence (stimulus or event) that follows and strengthens operant behaviorConsequence (stimulus or event) that follows and strengthens operant behaviorReinforcementTwo types of reinforcementBoth positive reinforcement and negative reinforcement strengthen behavior - make the behavior more likely to occur in the futurePositive Reinforcement Negative ReinforcementFunctional Definition of Reinforcement 1. The occurrence of a behavior2. Results immediately in a consequence3. The behavior is strengthened (more likely to occur again in the future in similar circumstances)ResponseConsequenceOutcome: Child is more likely to cry in the strollerEffects of Reinforcement on Behavior FrequencyFrequencyIncreasesDurationDurationQuicknessQuicknessIntensityIntensityDepending on your targetPositive ReinforcementBehavior is followed by the presentation of a reinforcer and the behavior is strengthenedNegative ReinforcementBehavior is followed by the removal of, or decrease in the intensity of, an aversive stimulus and the behavior is strengthenedEscapeBoth part of Negative ReinforcementEveryday Examples of Negative ReinforcementPositive and Negative Reinforcement in the Same Situation Try to identify the case of positive and the case of negative reinforcement in this example before going to the next slide.Nixon and Kissinger were sitting in the Oval Office of the White House discussing policy matters when King Timahoe, Nixon’s Irish setter, came in and began chewing on the rug. The president commanded him to stop. King Timahoe kept right on chewing. The president commanded again. More chewing. Finally, Nixon opened his desk drawer, took out a dog biscuit and gave it to King Timahoe.“Mr. President,” said Kissinger, “you have taught that dog to chew the rug.”(Valariani, R. Pet journal: That Kissinger dog. Ladies' home Journal, January 1976, 93, 126-129. Noted by Michael C. Roberts and David A. Santogrossi, Department of Psychological Sciences, Purdue University.)Positive and Negative Reinforcement in the Same SituationPrimary vs Secondary ReinforcersClicker Training – Conditioned ReinforcerClicker training exampleIn animal training and husbandry a clicker is frequently used to reinforce new behaviors. The clicker is an conditioned reinforcer that is paired with food or play to establish it as a reinforcer. It is sometimes referred to as a bridge or a marker since it immediately marks the behavior that is targeted.Click on the picture to see a video. Explore the website on your own to see some cool examples of training.Conditioned / Generalized Reinforcers •Paired with a wide variety of other reinforcers•Money•Praise•TokensNatural vs Contrived ReinforcersPavlov vs SkinnerShaping.Reinforcement of successive approximations of a target behaviorReinforcement of successive approximations of a target behaviorUsing