SellingUpdated 11 min read

Operant conditioning: how consequences build your sales habits

Operant conditioning is learning from consequences. What pays off right after you do it, you do again, and what costs you, you do less, and a sales week runs on it. Use the four types and the schedules to build a daily follow-up habit in five steps.

What operant conditioning is

Operant conditioning is learning from consequences. You do something, a result follows, and that result changes how often you do it again. The APA Dictionary of Psychology defines it as behavior change that happens as a function of the consequences of behavior, and lists two other names for it: instrumental conditioning and operant learning.

Every loop has three parts, and a sales morning shows all of them:

  1. The situation. It's 9am and the call list is open.
  2. The action. You dial the first name.
  3. The consequence. She picks up and books a meeting, or you get a curt no.

Run that morning enough times and the consequence decides whether 9am stays your calling hour. Nobody decides it on purpose. If the first call keeps ending in a brush-off, you'll drift into answering email at nine, and you won't remember choosing to.

Operant behavior is the kind you produce: you dial, you open WhatsApp to look for a reply. A flinch at a loud bang is a reflex, and reflexes are learned another way, called classical conditioning.

Thorndike's cats and Skinner's lever

The idea is older than its name. In Animal Intelligence, published in 1911, Edward Thorndike set out his law of effect. Of everything an animal does in a situation, he wrote, the responses closely followed by satisfaction get more firmly tied to it and come back when it does, while the ones followed by discomfort lose their hold.

B. F. Skinner gave the field its name. The B. F. Skinner Foundation tells how he built a cumulative recorder, a device that drew every lever press as a step up on a moving line. It showed him that how often a rat pressed depended on what followed the press, and not on any signal before it. He called behavior that acts on the world and is controlled by its effects operant behavior, and the arranging of those effects operant conditioning. The work went into The Behavior of Organisms in 1938, and Schedules of Reinforcement, written with Charles Ferster, followed in 1957.

For a seller, that means tomorrow's calling is shaped by what followed today's calls.

Which of the four types is it?

There are four types, and two questions sort any example into one of them. First, was something added or taken away? Added is positive and taken away is negative, and the two words carry no praise or blame here. Second, did the behavior go up or down afterwards? Up is reinforcement and down is punishment.

TypeWhat happensThe behaviorA sales example
Positive reinforcementSomething addedUpA prospect thanks you for the nudge, so you nudge sooner
Negative reinforcementSomething unpleasant removedUpSending the quote stops the daily chasers, so quotes go out faster
Positive punishmentSomething unpleasant addedDownA low number gets torn apart in the team meeting, so reps stop sharing numbers
Negative punishmentSomething good removedDownA rep who logs nothing for a week loses first pick of new leads

Negative reinforcement is the one that trips sellers up. Put off a call you dread and the dread eases at once. The APA's definition counts that kind of postponing as negative reinforcement, so the relief is a reward for skipping the call. Do it every morning for a month and avoidance turns into a trained habit. It's why sales call reluctance is so hard to shift: every skipped call paid you.

Reinforcement schedules: why you can't stop checking for replies

A schedule of reinforcement is the rule for which responses get reinforced: every one of them, or only some. There are many, and you'll meet four of them in any month of selling:

ScheduleThe reward comesOn a sales week
Fixed ratioAfter a set number of responsesA bonus for every fifth meeting booked
Variable ratioAfter a varying numberProspecting, where the yes lands on dial 3 one day and dial 30 the next
Fixed intervalFor the first response after a set timeThe commission run on the 25th of each month
Variable intervalFor the first response after a varying timeA reply to your proposal, which arrives whenever it arrives

The variable ratio schedule is named by its average. If one dial in ten turns into a meeting on average, but never on a set count, you're on VR 10. That's prospecting, and it's why a good rep keeps going through a dry morning. The partial reinforcement effect says a response rewarded only some of the time holds out longer once rewards stop than one rewarded every time. You're used to gaps, so a gap doesn't stop you.

The same effect works against you on your phone. Replies come at random, so checking for them runs on a variable interval, which the APA says keeps responding at a fairly steady rate. That's why you glance at WhatsApp every few minutes, even with a client sitting across from you. Take the randomness out by checking on a fixed clock you set, such as on the hour and after each call block.

Month end shows the fixed interval at work. Little happens in the first week, then the calls speed up as the commission run gets close. You know that curve as the last-week scramble. The APA's name for it is the fixed-interval scallop.

Shaping: from two follow-ups a day to ten

Shaping builds a new behavior by reinforcing closer and closer versions of it. The Skinner Foundation sums up the method: ask for what the learner does today, and reinforce each best response at once.

Say you want ten follow-up calls a day and you're making two. Asking for ten tomorrow means you miss, nothing gets rewarded, and the habit never starts. Shape it instead:

  1. Week 1: four calls a day. Every day you hit four counts as a win.
  2. Week 2: six a day, once week 1 held on at least four days out of five.
  3. Week 3: eight a day.
  4. Week 4: ten a day.

If a week falls apart, repeat it before you move on.

Extinction: when a lead goes quiet, and when you stop praising

In operant terms, extinction is what happens when reinforcement stops and the response that used to pay off gets rarer. Before it fades, it spikes: the APA records a burst of fast responding right when the rewards stop.

You'll see both on a quiet lead. The replies stop. First you burst: three messages in two days, each a little more eager. Then you stop for good, and the lead dies in your pipeline without a last word. Decide the spacing before the silence starts, and the burst never lands on the buyer's phone. Something like day 2, day 7 and day 14, then one message that closes the loop politely. The sales follow-up process has the spacing and a script for each touch.

Managers see it from the other side. Praise logged calls every day for a month and then go quiet, and you'll get a week of extra effort before the logging fades. Thin the praise out instead of stopping it, to something like two specific comments a week at your 1:1s.

Timing: why the payoff has to land in seconds

A consequence works best when it follows the action straight away. In the same chapter, Thorndike asked readers to picture four boxes whose doors open one, five, fifty and five hundred seconds after a cat turns the button. He wrote that the cat would form the habit of prompt escape fastest in the first box, and would almost certainly never form it in the fourth. A punishment given ten or twenty seconds after the act, he added, has little or no effect on it.

Five hundred seconds is just over eight minutes. The payoff from a sales call is a signed deal, and that arrives weeks after the calls that built it, so the call itself earns you nothing you can feel today.

So add a consequence of your own that lands in seconds. Log each call the moment you hang up and watch the count move. A paper sales call log does the job. In ActivityTracker you log a call in one tap, each call adds points, and your weekly goal fills in as you go, so the reward arrives while the call is still fresh.

Why punishment backfires on a sales team

Even Thorndike moved away from punishment. At first he said annoying consequences weaken a response. Later he cut that half from his law of effect and kept only the part where rewards make a response stronger.

On a team, a telling-off tends to land on the wrong behavior. Roast a rep for a bad week in front of everyone and here's what follows:

  • The number goes quiet. Reps stop showing it to you, and you find out on the last day of the month.
  • They know what not to do and have learned nothing about what to do instead.
  • They start avoiding whoever handed out the punishment, and that usually means your 1:1s.
  • Once the threat fades, the old behavior is back.

Rewards need care too. Edward Deci, Richard Koestner and Richard Ryan pooled 128 experiments in a 1999 meta-analysis. Tangible rewards that people expected made them less likely to keep at a task on their own once the reward was gone. Positive feedback did the opposite and raised both that measure and the interest people reported.

So in a 1:1, praise the exact thing you saw: "You called all six quotes from last week, even the one who went cold." That's the positive feedback the study found raising interest, and a gift card for the most dials is the expected, tangible reward it found lowering it. Save the prizes for results, and look at sales incentive ideas before you design a contest around activity.

Operant vs classical conditioning

Classical conditioning links a signal to an event. Operant conditioning links an action to its result. Ivan Pavlov discovered the first kind. In the APA's example, a tone comes just before food in a dog's mouth, again and again, until the tone alone makes the dog salivate.

ClassicalOperant
What gets linkedA signal and an eventAn action and its result
The responseA reflex you don't chooseAn action you produce
What comes firstThe signalThe action
Named forIvan PavlovThorndike and Skinner
At your deskYour stomach drops when a hard client's name lights up the phoneWhether you answer

Both run at once. The drop in your stomach is classical. Picking up or letting it ring is operant, and that's the half you can train.

Examples you already know

  • A coffee card that gives you the tenth cup free runs on a fixed ratio.
  • A dog that gets its treat the second it sits is learning by positive reinforcement, and the speed of the treat matters most.
  • A parking fine adds something unpleasant, so it's positive punishment, while losing the car keys for a weekend is negative punishment.

Your buyers are on schedules too. A client who keeps going back to the supplier who always answers within the hour has been reinforced every time they asked, so be that supplier.

Build a follow-up habit with it

Aim the loop at the follow-up calls you keep putting off, in five steps:

  1. Pick one action you control and can count. "Call everyone who got a quote in the last 14 days" works where "follow up more" doesn't. Reward the call itself, because the yes runs on the buyer's schedule and is too slow and too random to build a habit on.
  2. Fix the situation: the same time and the same place every day, such as 9:30 after the stand-up, with the list already open.
  3. Pay yourself right after by logging the call and ticking the name. When you hit the day's number, take a ten-minute walk.
  4. Start by rewarding every call for two weeks, then thin it out to the day's number plus a bigger treat for five days running.
  5. Review on Friday. Look at the count instead of your mood, and if something needs changing, change the target or the time.

Give it longer than a week. In a 2010 study, Phillippa Lally and her colleagues at University College London had 96 volunteers pick one thing to eat, drink or do daily in the same context, such as after breakfast, and track it for 12 weeks. Reaching their peak automaticity took from 18 to 254 days, and missing one chance to do the behavior did not materially affect the habit forming, so one bad day doesn't reset you.

A daily routine in ActivityTracker keeps a streak of the days you hit its target in a row, which turns step 4's five-day run into a number you can see. To fit the calls into your morning, start from the daily sales routine template, which puts the call block first.

Give every call a payoff in seconds. In ActivityTracker you log a call in one tap, it adds points toward your weekly goal, and a daily routine keeps a streak.

See the one-tap activity log

Priya's four weeks

Made-up example: Priya sells office cleaning contracts, sends eight to ten quotes a week and follows up on two a day at most, usually after 4pm.

Her action: call every quote from the last 14 days, at 9:30, before email. Week 1's target is four calls a day. She logs each call as she hangs up and takes a walk when she hits four.

Week 1: she hits four on every day but Wednesday, when a site visit eats the morning. Four days out of five holds, so she moves to six.

Week 2: six a day, all five days. One office manager, Mr Tan, stops replying after asking for a revised quote. Priya wants to message him twice that afternoon. Instead she puts day 2, day 7 and day 14 on her list and writes the closing message in advance.

Week 3: eight a day on four days. Friday's review shows the miss was Monday, after a weekend away, so she sets Monday's target two lower.

Week 4: ten a day Tuesday to Friday and eight on Monday. Mr Tan answers her day 14 message and asks for a call next month.

None of her rewards depended on a yes, and the calls kept coming.

Where the theory stops

Operant conditioning explains a lot of a sales week. It doesn't explain all of it:

  • It deals with what you do and says little about what you think. A rep who believes the product is wrong for the buyer won't be fixed with points.
  • Not every slump is a reinforcement problem. A bad list, a weak offer or a territory with no buyers looks the same on the call count. Check those first.
  • Behavior therapy uses it too. Leave that to trained therapists and keep your own use to the call list.

Use it to start and keep small behaviors, like the first call of the day or the follow-up you keep pushing back.

What to do first

Pick one follow-up action for tomorrow, such as calling everyone who got a quote in the last 14 days. Set a number you can hit, even if it's three. Put the time in your calendar, log each call the moment you finish it, and give yourself something small when you hit the number. Look at the count on Friday and set next week's number one step higher.

Keep reading

Questions people ask

Sources

Pay yourself for the call.

The yes runs on the buyer's clock, and the call runs on yours.