Thanks for publishing this. I’ve been around the rationality community for a few years and heard TAPs mentioned positively a lot without knowing much about them. This roughly matches my best guess as to what they were but the extra detail is super useful, especially in the implementation.
has proven useful to the majority of our alumni
Curious as to how this was established. I can see lots of ways for confirmation bias to creep into this.
A variety of methods all pointing in similar direction (post-workshop surveys, frequency of use and mention in one-on-ones with participants in the years afterward, takeup in the broader rationalist/EA/longtermist communities, mention in posts in other places like FB and LW, iteration and variation in content put out by alumni, etc). Dan Keys could probably say more concrete things.
I guess I should've also stressed the difference between alumni thinking it's proven useful (which is easy to determine) and it actually being useful in accomplishing stuff (which is the more interesting and harder to determine part).
None of the things you mention seem like fool-proof methods of determining the second case.
True, but also Bayes. Be careful not to cargo-cult skepticism; when you're dealing with a set of hundreds of people all telling you that Thing X was useful for them personally (especially when Thing X came from a menu of things, and it's being highlighted particularly), the most reasonable hypothesis is that it was useful.
Like, yes, people self-deceive, and yes, people misdiagnose. But it would be genuinely silly and not particularly rational for someone in my shoes, being directly exposed to these reports, to weirdly privilege the "nuh-uh" hypothesis.
Seems reasonable for you, one degree removed, to maintain a little skepticism. But I think people ... fetishize? ... a certain kind of hard, sterilized data, instead of recognizing that that certain kind of hard, sterilized data is one path to confidence, among many. It is indeed important to be able to prove mathematically that something is a triangle, and you can build a much taller tower of knowledge on a foundation that sturdy, but you can also just look, and recognize triangles quite effectively.
TAPs are useful for humans, as literally dozens of studies have shown. They have also proven useful to CFAR's alumni, who are also humans, and this is not a surprising result.
I'm not exactly claiming that it is or is not useful in improving outcomes, I'm just wondering if any "hard, sterilized" data exists.
Anyway...
Your comment does make me wonder some things. Take the following more as me exploring my state of mind on a lazy Sunday afternoon and less as a retort or rebuttal.
I'm not sure that we actually disagree...it's hard to quantify the amount of skepticism we're both talking about. You can't say "you should be skeptical level 3" and I can't say "no you should be skeptical level 4.3". For all either of us knows from the conversation so far is that I'm less skeptical than you!
Be careful not to cargo-cult skepticism
Yes, I think this is a dangerous failure mode...but I think it's likely that the flipside is a more common failure out there in the real world.
dealing with a set of hundreds of people ... the most reasonable hypothesis is that it was useful.
Maybe? I'd have to think about that more. However, being the most reasonable doesn't mean there are no other reasonable hypotheses. We should work hard to increase the "reasonableness delta" so that we can increase our confidence.
There's millions of otherwise reasonable and successful people (often people I respect) telling me that they talk to ghosts or that loading up on Vitamin Omega Delta Seventeen Power Plus is the key to perfect health.
Combine that with the fact that this intervention seems pretty susceptible to not being able to distinguish between "feels useful" and "is useful" and this is the largest item raising my skepticism level. Whether this is true could be an interesting line of inquiry.
We just have to use other things like "does not conflict with how I think the world works" and "these people are generally (in)correct about subjects in this area" and "how likely is it that they tricked themselves" to weight the evidence of "these people say this is useful" to adjust our skepticism level towards the appropriate amount.
Millions of people tell me lots of things like "statins work" and "drunk driving increases risk of bad things". I'm less skeptical of those things because of the same sort of things mentioned in the previous paragraph.
To me, by far the strongest point in reducing the skepticism level is the studies backing up TAP. In fact, it seems like this point is so strong that I'm a little confused by the proportion of your comment directed towards "believing people" vs "TAP studies".
I'm not interested enough in the subject to dive into the studies, but if I was I'd really be looking into whatever delta existed between CFAR's practices and the literature. (Besides trying to generate the hard, sterilized data, of course)
All that being said, I'm still not sure if I'm more or less skeptical than you on the subject.
this intervention seems pretty susceptible to not being able to distinguish between "feels useful" and "is useful"
I'm curious to hear more of your model here, even if all you have is something half-baked. Like, if you would be willing to ELI5 why this intervention seems susceptible in this way, or paint me a picture of someone thinking that it's useful but being wrong.
There's millions of otherwise reasonable and successful people (often people I respect) telling me that they talk to ghosts or that loading up on Vitamin Omega Delta Seventeen Power Plus is the key to perfect health.
... I am surprised by this. Mostly, I'm surprised by you assessing those people as otherwise reasonable. I think I view people's capacity for reason as less compartmentalized, or something, and would find myself suspicious of all of their other conclusions if they talked to ghosts or loaded up on VOD17P+. Like, this wouldn't stop them from being right-for-the-wrong-reasons, but I just wouldn't be able to call them reasonable.
I do note that while the set of CFAR participants is not stellar in some absolute sense, it contains a much higher base rate of healthy skepticism and epistemic diligence/hygiene than most groups. Like, CFAR participants on the whole are a self-selected "at least nominally cares about what's actually true" group, and I think I weight their self-reports accordingly? I trust the CFAR participants somewhere in between my trust for [college juniors majoring in fields that require grounding and feedback loops] and [college professors teaching in such fields], as a rough attempt to calibrate.
I've long believed TAPs are a fundamental skill-building block. But I've noticed lately that I never really gained, or solidified as well as I'd like, the skill of building TAPs.
I just reread this post to see if it'd help. One paragraph that stands out to me is this:
And in cases where this is not enough—where your trigger does indeed fire, but after two weeks of giving yourself the chance to take the stairs, you discover that you have actually taken yourself up on it zero times—the solution is not TAPs! The problem lies elsewhere—it's not an issue with your autopilot, but rather with your chosen action or some internal conflict or hesitation, and there are other techniques that can be used to illuminate and solve those problems.
and the Tips for TAPS section, which help clarify what TAPs are for.
I think my biggest confusion right now is how to get TAPs to reliably fire, in a chaotic world. I had set a tap recently of "make sure to close a particular door fully, every time I used it." I practiced doing it as I walked through a few times. But then it failed to fire when I was carrying a heavy thing, or in the middle of a conversation, or when I was walking my scooter through the door. I couldn't figure out a way to practice the trigger that was versatile/robust. I would practice on each new variation I noticed, and I'd try practicing other variations to "cross train", but they never seem to generalize to the situations I actually need.
...
I find this bullet confusing:
Try gain-pain movies—first imagine some exciting or attractive aspect of the future where you’ve achieved your goal, and then think about the obstacles that lie between you and that future, and then repeat several times.[1]
I think I've previously read this sort of thing with a "and then, visualize overcoming those obstacles" clause, or something similar.
Hmm:
Locke and Latham (2002) review decades of research on goal setting and performance. Among their findings: people who set a challenging, specific goal tend to accomplish more than people who set a vague goal (such as “do as much as possible”) or those who set an easy goal.
On one hand, I think I have set challenging/specific goals for myself, but I think some part of me is still just going through life with an overall "try to do more good in the world" lens. I guess I do regularly channel that into concrete things, but I could maybe use more specificity sometimes.
This is huge if it works; you're basically able to reprogram your entire life.
I haven't gotten it to work yet, this post makes it look like it's not that hard to set up. In my case at least, it will probably require multiple days to set the trigger. Probably worth many hours of effort to set a trigger for "stop and think about what I should be thinking about", but I've heard at least one other person having a hard time setting the trigger such that it would go off.
I, at least, was led to think by this post that it would less effort than actually required, and on that front it was unhelpful (though this risk was accounted for by the "adjust your seat" section of a preceeding chapter).
I still consider this to be a very helpful thing to share with people and near the top of my sharing list due to the value of its model alone, and like tuning your cognitive strategies the potential is massive, but for a 15 minute post, it would have been nice if it warned me that I would have to see how long it takes to set a trigger in order to decide what kinds of things I set triggers for.
If it takes off, I'll personally promote this post enough among high-value people, more than enough to compensate for giving it a so-so review here.
implementation intentions are an externally studied idea, renamed to "trigger action plans" in this subcommunity. https://en.wikipedia.org/wiki/Implementation_intention
Summary:
Will this become a mostly-optimized second-edition/ultimate CFAR handbook? It seems like something the world needs right now, I can see it circulating among executives etc. and then many of them might wonder where such a thing came from.
The hope is that the lightly-edited version will do for now, in lieu of more fundamentally principled/complete approaches. The CFAR curriculum is great, but it grew from a very particular context and also came together over time in response to very particular problems. Mainly this is going up so that the perfect (a full refactoring of the applied rationality approach) doesn't become the enemy of the good (the existing content becoming more easily available and discussible).
Summary:
Epistemic status: Established and confirmed
There has been a tremendous amount of research on “implementation intentions” since their development by psychologist Peter Gollwitzer in the late 1990’s. A meta- analysis of 94 studies involving 8461 participants found that interventions using implementation intentions were an average of .65 standard deviations more effective than control interventions. Similar effect sizes were found in the 34 studies which looked at behavioral change on personal or health goals (average of .59 standard deviations more effective). Trigger-action planning—our version of implementation intentions—draws directly on this research and has proven useful to the majority of our alumni for a wide range of problems, tasks, and goals.
In previous sections of this book, we’ve looked at the differences between System 1 and System 2, talked about the process of turning goals into plans, and learned to distinguish useful and relevant practice from irrelevant or unproductive practice. In this section, we will combine those insights and their implications into a single, robust technique for building awareness and supporting behavioral change.
Complex chains: The parable of the Sphex
Sphexes are a genus of wasps, and for many years, a story about their behavior has been a major touchstone in cognitive science. Typically, when it comes time for egg laying, a sphex will build a burrow and fill it with paralyzed insects for her future larvae to eat. When hunting, she will sting her prey, wait for the venom to take effect, drag the prey back to the burrow entrance, leave it outside while she goes in and reconnoiters (presumably confirming the absence of predators or structural problems), and finally come back out to drag her victim inside.
This sequence of actions is elaborate, organized, and complex, and on the surface seems to indicate an impressive level of mental sophistication for an insect whose brain weighs less than a milligram. However, in 1879, French entomologist Jean Henri Fabre decided to dig deeper:
Fabre’s own experiments on other wasps (from the same colony, from the same species but other colonies, and from other species) showed that this was not the only possible result—many wasps eventually break the pattern and drag their prey straight into the burrow. But even the quickest tend to repeat themselves four or five times, implying that the overall process is less a single, coherent strategy and more a series of disconnected if-then actions:
By “chaining together” a series of simple, atomic responses (e.g if I come out of my burrow and there’s a paralyzed cricket, drag it inside immediately), the sphex is able to execute complex, multi-step behaviors as if it were capable of thinking and planning ahead—even though it largely isn’t. The “intelligence” lies in the algorithm, rather than in active cognition.
The trigger-action pattern
There is another species that is capable of chaining together a series of atomic reflex actions into complex and appropriate behavior without any need for active cognition—humans! In many respects, this is what our System 1 is for—it’s constantly running in the background, aggregating all of our lived experiences and guiding our actions when we’re not paying attention. It’s because of our System 1 that we can do things that approximate multitasking—carrying on conversations while eating, thinking about upcoming weekend plans while driving in light traffic, exercising while watching TV.
One of the ways we manage this is with a host of trigger-action patterns, derived from our model of the universe and constantly reinforced through experience:
These actions are generally quick and effortless, with our conscious minds rarely getting involved (and usually only if we run into problems, like when we get caught in “...I’m fine, and you?” loops, or when you head toward the office even though it’s the weekend, or when the left turn arrow causes you to take your foot off the brake, even though you’re going straight).
The examples above are single-step, but we all have chains, as well, for any complex task we’ve spent time reinforcing—the series of actions you take in the shower or upon arriving home, the lines of an argument you’ve had ten times already, the flow you experience while playing sports or working with machinery or playing jazz or pushing code to Github. Most people who drive spend only the tiniest amount of attention actively thinking about driving while on the road—barring heavy traffic or sudden surprises, we maintain control of our cars with dozens of trigger-action patterns.
Not every pattern is visible or obvious, either—think about the triggers that cause you to smile, or sigh, or tense up, the reliable causes of a good or bad day. We each have triggers which result in a particular emotion (often referred to as trigger-affect patterns), or triggers which bring specific words or memories to mind (like the first few words of a well-known song, or the first half of a common phrase). Sometimes these can chain and reinforce, too, all inside our heads—some stray thought triggers an emotion, and that emotion triggers another thought, which reminds us of something else, which elicits further feelings, and so on.
Consider the following:
You're trucking along, living a generally good and happy life, and then something happens, and you find yourself in the sad timeline instead of the happy one. You ate an entire package of Oreos, despite intending to lose weight. You got in another fight with your romantic partner, despite genuinely not wanting to. You just straight-up forgot about your new year's resolution; it never came to mind. You road-raged, you failed to finish the presentation before the deadline, you spent all evening on Reddit instead of thinking about your research, you somehow never called them back and now it's been months and it feels too awkward.
There are a few interesting takeaways from thinking about situations like those in terms of an image like the one above.
First: for most goals and values, there actually exists a moment-of-departure from [a path consistent with the positive outcome] and [a path consistent with the negative one]. There is usually an identifiable point at which one of those outcomes becomes distinctly more likely than the other (though it may be hard to pinpoint, even after the fact).
Second: in most cases, the paths tend to get farther and farther apart over time. It's rare that one instantaneously and irrevocably leaps from 🙂 to 🙁; most of the time, there is a shift in trajectory, and one's prognosis worsens as continued-progress-along-the-wrong-path compounds.
You could think of the distance between the dotted and solid lines as a measure of the total effort required to make it back to the better timeline. The quicker you notice that you've changed course, the shorter the distance back to the better path. The less time that you've spent accelerating in the wrong direction, the less inertia you have to overcome.
Which leads to one of the key actionable insights of the TAPs perspective: there are times when the total effort to switch from 🙁 to 🙂 is zero, or close enough—e.g. simply catching the moment when you would have made the unfortunate switch, and then not doing so. In many, many cases, an epsilon of prevention is worth an omega of cure.
To put it another way:
It's not that far off to declare humans to be simply slightly-more-complicated sphex wasps, largely following the path of least resistance in accordance with a preset autopilot.
To change the outcome of a given situation, then, there must be either a) some change to the autopilot itself, or b) some turning-off of the autopilot, summoning effortful sapience.
In both a) and b), it pays to know which moment is the critical moment—either which specific if-then to change, or when a pilot's attention will do better than the preprogrammed defaults.
TAPs: From patterns to plans
A full understanding of trigger-action patterns requires close attention to concrete detail. It’s less about things like “when I exercise, I get discouraged” and more about “when I run for a while, my chest starts to ache, and when my chest starts to ache, I start thinking about how far away the end is, and when I start thinking about how far away the end is, my enthusiasm for getting fit vanishes.”
In cognitive behavioral therapy, patients are often taught to monitor their thoughts for specific words or phrases that have emotional power; kids who struggle with ADHD are sometimes encouraged to note exactly what happened right before they got distracted, and the first thing that caught their attention once they looked away.
This level of detail allows us to break down our behavior into blocks and parts, giving us a language to encode both physical and cognitive actions. That encoding often brings with it understanding and insight—a sort of gears-level awareness of what our brains are doing from moment to moment— and that insight, in turn, gives us a powerful tool for change.
In CFAR parlance, the word “TAP” refers not only to trigger-action patterns, but also to trigger-action plans—plans which center on taking advantage of these short causal chains. TAPs are simultaneously one of the most basic and most effective tools for tinkering with our own habitual behavior, and since a large percentage of our behavior is habitual, that makes them one of our best tools, period.
Once you’re familiar with the technique, making a TAP is simple, and often takes less than a minute. It’s a quick, four-step process:
To start with, it’s often easiest to take existing trigger-action patterns and tweak them; sometimes changing one key link in a chain can produce an entirely new behavior. For instance, if you have a goal of exercising more, you might notice that your usual routine has you walking into the building and heading straight for an elevator. You can increase your daily physical activity with a simple TAP—when you feel the metal of the door handle (trigger), you’ll remember to look over at the stairwell (action).
Why this particular framing, instead of something like “When I go inside the building, I’ll take the stairs”? For starters, the trigger go inside the building is a little bit fuzzy. It would probably work for some people, but especially when you’re just starting to learn TAPs, it’s best to err on the side of concreteness and specificity. Feeling the metal of the handle against your palm, or hearing the squeak of the hinge, or noticing the change in temperature as you step inside—these things are clear-cut and unmistakable.
As for the action of take the stairs, well—taking the stairs is certainly specific. The problem is that it’s a relatively large action, and one that might plausibly require willpower for a lot of people. That doesn’t mean you shouldn’t do it, it just means you might want to leave it out of your TAP. One of the things that makes TAPs so powerful is that, done correctly, they don’t take effort. They build on your ordinary momentum, working by reflex and association, just as you don’t have to try to eat chips when there’s a bowl of them in front of you.
When embarking on any kind of significant behavioral change, it’s easy to get discouraged—to hit a few early failures and feel like abandoning the whole plan. TAPs, as a class, fail in one of two places:
Earlier versions of CFAR's TAPs classes did recommend actions such as "take the stairs," but following up with participants revealed that the pattern that was actually installed was often something of the form "when I feel the metal of the door handle, I will feel guilty and say mean things to myself the whole time I'm on the elevator."
By setting an action like "look at the stairs," you're both making that second failure mode much less likely (since just looking is a much lighter action), and also avoiding a kind of locking-yourself-in-a-box, predeciding-the-right-strategy kind of mistake. Rather than turning yourself back into a sphex, you are instead summoning sapience—turning off your autopilot for a moment. The TAP is a sort of pop-up dialog box that says "Hi there! This is a chance to remember that you had a goal to take the stairs more often. Would you like to do anything about that?"
In many cases, this is enough—CFAR instructor Duncan Sabien found that the best intervention to cause him to use his expensive elliptical machine was simply to touch it, each morning, as he came out of his bedroom. The problem was that Duncan's ordinary default habits didn't include using an elliptical. By walking down the hall and touching it, he shook himself out of his mindless autopilot, and subsequently spent some of his shower time thinking over the day's schedule and forming intentions about when he could most easily fit in a run.
And in cases where this is not enough—where your trigger does indeed fire, but after two weeks of giving yourself the chance to take the stairs, you discover that you have actually taken yourself up on it zero times—the solution is not TAPs! The problem lies elsewhere—it's not an issue with your autopilot, but rather with your chosen action or some internal conflict or hesitation, and there are other techniques that can be used to illuminate and solve those problems.
This isn’t to say that the more heavy-duty kind of TAP is off-limits. People do indeed get value out of just making themselves do the thing. As you grow more comfortable with TAPs, you'll get a better sense of what's viable and sustainable within your own motivational system. As usual, though, we recommend that you build form first—starting off with lightweight practice before putting your skills to a serious test.
TAP: Grab handle of shopping cart → Ask myself whether this is a “healthy” shopping trip, or a regular one
TAP: Notice that something made me think of a particular friend → Write it down right away on my list of possible birthday gifts
TAP: Drop my keys into the bowl by the door → Pause and think get the book and put it with my keys.
Tips for TAPs
Good places to use a TAP:
Selecting the right trigger:
Selecting the right action:
Making TAPs stick:
Getting better at TAPs generally:
Be patient with yourself
Trigger-Action Planning—Further Resources
Logan Strohl's Intro to Naturalism sequence focuses on building a particular kind of awareness that could be framed as "TAPs for Noticing."
Locke and Latham (2002) review decades of research on goal setting and performance. Among their findings: people who set a challenging, specific goal tend to accomplish more than people who set a vague goal (such as “do as much as possible”) or those who set an easy goal.
Locke, E. A., & Latham, G. P. (2002). Building a practically useful theory of goal setting and task performance: A 35 year odyssey. American Psychologist, 57, 705-717. http://goo.gl/9krv3Q
Gollwitzer and Oettingen (2011) review research on planning and goal pur- suit, with an emphasis on implementation intentions (trigger-action plans). They discuss evidence that implementation intentions can be helpful for several subskills of goal pursuit, including getting started, staying on track, overcoming obstacles, and taking advantages of opportunities, as well as cases where implementation intentions are less effective (such as when a person is not very committed to the goal). They also include specific suggestions for how to formulate trigger-action plans.
Gollwitzer, P. M., & Oettingen, G. (2011). Planning promotes goal striving. In K. D. Vohs & R. F. Baumeister (Eds.), Handbook of self-regulation: Research, theory, and applications (2nd ed., pp. 162-185). New York: Guilford. http://goo.gl/Dj8NC
A meta-analysis of 94 studies involving 8461 participants found that inter- ventions involving implementation intentions produced an average effect size of d = 0.65 (Gollwitzer & Sheeran, 2006). A similar effect size was found in the 34 studies which involved behavioral change on a personal or health goal (d = 0.59).
Gollwitzer, P. M., & Sheeran, P. (2006). Implementation intentions and goal achievement: A meta-analysis of effects and processes. Advances in Experimental Social Psychology, 38, 69-119. http://goo.gl/AHHUUk
Mental contrasting is the practice of imagining a desired future where a goal has been achieved, and then contrasting it with the current imperfect situation where there are still obstacles to achieving the goal. Oettingen (2012) reviews dozens of studies showing that mental contrasting tends to increase commitment to a goal, including energy and determination, in a way that does not occur in people who merely fantasize about a desired future, or in those who merely think about the current situation and its obstacles (though this effect only occurs when the desired future seems achievable).
Oettingen, G. (2012). Future thought and behavior change. In W. Stroebe & M. Hewstone (Eds.), European Review of Social Psychology, 23, 1-63. http://goo.gl/ov54yp
Mental contrasting can be a helpful precursor to the formulation of implementation intentions, since it increases goal commitment and brings to mind obstacles which trigger-action planning can address. Several experiments involving real-world behavior change have used an intervention which combined mental contrasting and implementation intentions, and one such study (Adriaanse et al., 2010) found that this combined intervention was more effective than either one alone at reducing consumption of an unhealthy food.
Adriaanse, M. A., Oettingen, G., Gollwitzer, P. M., Hennes, E. P., de Ridder, D. T. D., & de Witt, J. B. F. (2010). When planning is not enough: Fighting unhealthy snacking habits by mental contrasting with implementation intentions (MCII). European Journal of Social Psychology, 40, 1277-1293. http://goo.gl/MCV88X
Psychologist Heidi Grant Halvorson’s book Succeed provides a practical summary of research on goal achievement, including an account of implementation intentions and mental contrasting.
Halvorson, Heidi Grant (2010). Succeed: How we can reach our goals. http://www.heidigranthalvorson.com/
First developed by psychologist Gabrielle Oettingen under the name “mental contrasting.” Gain-pain movies have been shown to be an excellent companion to TAPs, increasing enthusiasm, emotional resistance, and awareness of goal relevance.