A Focus on Intermittent reinforcement
by Sheila S. Blanchette, IAABC-CPBC, UW-AAB, Director of Education, Rhode Island Parrot Rescue.
When teaching a companion bird a new behavior, a Functional Assessment or Training plan evaluates and measures each of the incremental steps achieved. Functional Assessment/Training Plans usually include Positive Reinforcement Methodology to improve the likelihood that behavior will occur. “Parrots learn from feedback in the form of consequence in the form of consequences, just like humans. They experience consequences of their behavior and decide whether to repeat it or modify it in the future.” 1
“A large part of behavior, however, is reinforced only intermittently.” 2 It may seem that if a behavior is reinforced intermittently, the behavior will decrease or stop. Continuous reinforcement occurs if going to a vending machine, placing money in the vending machine, and consistently getting a favorite item. The expectation is that a favorite item is delivered by putting money in the machine. Returning to the same vending machine, money is added to the vending machine; this time, no favorite food item comes out. More money is placed in the vending machine, and the favorite food comes out this time. Are you likely to go to the machine again? Probably because there is intermittent reinforcement, food comes out occasionally.
When reviewing a companion bird training plan, incremental steps transition from continuous to intermittent reinforcement. Unlike Continuous Reinforcement, Intermittent Reinforcement does not give a consequence(reinforcer) after the behavior every time it occurs. By gradually introducing Intermittent Reinforcement after the initial learning phase, trainers can strengthen the desired behavior, ensuring it persists even when consequences(reinforcers) are not consistently provided.
Example Time:
Chained Behavior - “A series of separate behaviors or response elements that must be performed in a particular order to result in reinforcement.” 3
An example of chained behavior is teaching your companion bird to step up from a perch inside the cage to on your arm or hand.
Each of the steps below is an Incremental Step. Each step would be done independently until the companion bird consistently performs the behavior, at this point, you would move to the next incremental step.
Increment Step 1: Teaching the companion bird to step on a perch on the inside of the cage door
Antecedent(action before the behavior): You tap your finger by the perch, which is located inside the cage door.
Cue(signal for the behavior): you say, “Station”
Behavior (action by companion bird): The companion bird positions both feet on the perch inside the cage door; its head is raised, and its body posture is upright and balanced.
Mark the behavior(signal to end the behavior): you say, “Good Job”
Consequence(action after the behavior): You give a yummy treat or a head scratch
Increment Step 2: Open the cage door while the companion bird stays on the perch. (In this example, we are not including the training of teaching duration of staying on the perch, as this will make the blog even longer. )
Antecedent(action before the behavior): Start to unlock the cage door
Cue(signal for the behavior): you say ,“Stay”
Behavior(action by companion bird): The companion bird has two feet on the perch on the inside of the cage door. Its head is up, its body posture is upright and balanced, and the companion bird continues to stay on the perch (duration).
Mark the behavior(signal to end the behavior): you say, “Good Job”
Consequence(action after the behavior): You give a yummy treat or a head scratch
Increment Step 3: The cage door is open, the bird stays on the perch, and your arm/hand is presented for step-up
Antecedent(action before the behavior): You present your hand/arm in front of the companion bird
Cue(signal for the behavior): you say, “Step up”
Behavior(action by companion bird): The companion bird places two feet onto the hand/arm; the head is up, and the body posture is upright and balanced on the hand.
Mark the behavior(signal to end the behavior): you say, “Good Job”
Consequence(action after the behavior): You give a yummy treat or a head scratch
At the end of each incremental step, you always have a consequence (reinforcer) – continuous reinforcement. Once the companion bird is performing incremental step 1, which is going to perch, at a fluency rate of 90%, the training criteria can incorporate staying(duration) on the perch when the cage door is open. These steps will be chained behavior.
Chained Behavior #1:
Antecedent(action before the behavior): You tap your finger by the perch, which is located inside the cage door.
Cue(signal for the behavior): you say, “Station”
Behavior (action by companion bird): The companion bird positions both feet on the perch inside the cage door; its head is raised, and its body posture is upright and balanced.
Antecedent(action before the behavior): Start to unlock the cage door
Cue(signal for the behavior): you say ,“Stay”
Behavior(action by companion bird): The companion bird has two feet on the perch on the inside of the cage door. Its head is up, its body posture is upright and balanced, and the companion bird continues to stay on the perch (duration).
Mark the behavior(signal to end the behavior): you say, “Good Job”
Consequence(action after the behavior): You give a yummy treat or a head scratch
Notice that there is no consequence for “Stationing” on this chained behavior. The training behavior criteria changed along with the time the consequence (reinforcer) occurred. Now, if during this chained behavior, the companion bird may not stay on the perch when moving to the following behavior, the consequence would return, and then the next repetition of the behavior does not include it.
The Final Chained Behavior:
Antecedent(action before the behavior): You tap your finger by the perch, which is located inside the cage door.
Cue(signal for the behavior): you say, “Station”
Behavior (action by companion bird): The companion bird positions both feet on the perch inside the cage door; its head is raised, and its body posture is upright and balanced.
Antecedent(action before the behavior): Start to unlock the cage door
Cue(signal for the behavior): you say ,“Stay”
Behavior(action by companion bird): The companion bird has two feet on the perch on the inside of the cage door. Its head is up, its body posture is upright and balanced, and the companion bird continues to stay on the perch (duration).
Antecedent(action before the behavior): You present your hand/arm in front of the companion bird
Cue(signal for the behavior): you say, “Step up”
Behavior(action by companion bird): The companion bird places two feet onto the hand/arm; the head is up, and the body posture is upright and balanced on the hand.
Mark the behavior(signal to end the behavior): you say, “Good Job”
Consequence(action after the behavior): You give a yummy treat or a head scratch
“Trainers usually move from a continuous reinforcement schedule to an intermittent schedule with a high rate of reinforcement and gradually stretch (or thin) the ratio over time.” 4
The intermittent reinforcement schedule is part of the Schedules of Added Reinforcement, which is an important concept in companion bird training. Unlike continuous reinforcement, where every correct behavior is reinforced, intermittent reinforcement provides reinforcement at irregular intervals. This approach can lead to more durable behavioral changes because the companion bird learns to persist in the desired behavior, even when reinforcers are not always guaranteed.
Remember, once the companion bird learns a behavior, adjust the criteria. Ah, wait. What if the companion bird steps up every time without issue or does not step back? Do I give a consequence (reinforce) every time?
Never presume that a companion bird always understands the requested behavior that has been reinforced in the past. “Continuous reinforcement helps establish a clear connection between the request and the behavior. When transitioning to intermittent reinforcement, it's important to remain attentive and consistent in your requests and feedback.” 5 Gradual changes in reinforcement can help solidify the learning, but if reinforcement is completely paused, the bird may become confused or discouraged. Always support the learning process by providing reinforcement as needed, especially when introducing new behaviors or cues. The behavior can be placed on variable ratio schedules. “Instead of providing a reinforcer when a behavior has occurred a fixed number of times, it is possible to vary the requirements around some average. After each request of the trained behavior, instead of reinforcing every time, reinforce the behavior on the 2nd time of the request, then on the 5th time of the request, and then back to the 2nd time. “6
References:
1. S.G. Friedman, Ph.D, How Parrots Learn to Behave, Bird Talk, May 2003
2. B.F. Skinner,(1953) Science and Human Behavior, (p99),The B. F. Skinner Foundation
3. S.G. Friedman,(2010), Ph.D, 50 Word Learning and Behavior Glossary
4. James O’Heare, (2015), The Science and Technology of Animal Training,(pp. 61 – 66) DogPsych Publishing,
5. Tarbox, J., & Tarbox, C. (2017). Training Manual for Behavior Technicians Working with Individuals with Autism (pp. 35-47). Academic Press. https://doi.org/10.1016/C2015-0-06166-4
6. Paul Chance, (2003), Learning & Behavior, (pp. 350 -351), Wadsworth, ISBN 0-534-59868-4
Copyrighted. Blog posts may be used as guidelines for the proper care of your parrot. Not intended for medical or legal advice. Please consult with a licensed avian veterinarian regarding the medical care and wellbeing of your exotic pets.