Instrumental Rationality Mini-Retrospective
I promised several years ago to write a retrospective on Hammertime a year after it was released. I broke that promise but I wanted to take some time to do the work now, and to summarize my current beliefs about how much rationalist self-improvement affected my personal growth. I'd also like to estimate how it compares to other schools of self-improvement I've dabbled in.
First, I should mention that epistemic rationality has been directly useful in my career, although this is highly unlikely to generalize. At least three of the best papers I wrote in graduate school featured tricky applications of Bayes' Theorem. I was able to do from muscle memory certain calculations about conditional probability and expectation that might have taken weeks otherwise (if we figured them out at all). I attribute this ability in large part to reading the Sequences. YMMV if you don't work in or adjacent to probability theory. The rest of this review will ignore this relatively idiosyncratic improvement and focus on my beliefs about what is usually categorized as "instrumental rationality."
Over the last three years, I've seriously attempted the following "self-help schools of thought": CFAR applied rationality, therapy, Jordan Peterson, Tony Robbins. Insofar as numbers mean anything, in terms of personal progress in my life: CFAR is responsible for a ~100% improvement, therapy ~15%, Jordan Peterson ~40%, and Tony Robbins ~200%. Tony Robbins I encountered quite recently so the error bars are the biggest, and the effects have not yet had time to play out. As weak but verifiable evidence that the other three actually made an impact on my life, my publishing rate at least doubled since CFAR, the theorems have improved despite this. Also, I believe the quality of my writing has radically improved in these three years.
For a few more gears into these numbers:
CFAR is unique in that it (a) synthesizes the best bits of many other schools and couches it in language that is palatable to its target audience, (b) immerses you in practice in a way that any other immersive workshop does approximately equally well, but is nevertheless strong in a way regular practice and habit isn't, and (c) is astronomically memetically safe compared to the alternatives, due to deliberate choices like noting when models are "fake but useful but definitely fake."
Therapy can be hit-or-miss, the average-case scenario seems to be roughly that you pay a savvy friend armed with one or two CFAR techniques to listen and consciously apply that technique once a week. Still probably worth it.
Jordan Peterson was very useful as a charismatic psychology professor. His Youtube lectures seem to be the best available resources on the subject, and I don't believe there is a single other source that will get you the same level of understanding of the academic literature at the same cost in effort. What you get out of that abstract understanding will depend primarily on your general problem-solving ability. I don't believe there's anything remarkable about his self-improvement philosophy, although doing it will help (just because doing anything like this helps).
Tony Robbins is the best-in-class person at simultaneously blasting every part of your brain with charisma and motivation, and works for a general audience of homo sapiens (unlike CFAR). He is also extremely memetically dangerous - he knows all the buttons of the human brain that have been discovered and will push whichever ones it takes to effect the change he envisions. (For example, much of his technique rests on attaching positive meaning to suffering.) If it's any comfort, his intentions seem to be about as good as one can possibly expect for someone armed from adolescence with this superweapon. He is currently my leading candidate for "human best at getting out of the AI box." I do not believe I could have safely jumped into watching a bunch of his videos, learned a lot, and jumped back out, without much of the preparation and growth I got from the other sources listed above.
To be clear, the papers would almost certainly have gone through anyway, the helpful thing was being very comfortable with Bayes rule and immediately noticing, for example, that conditioning on an event with probability 1-o(1) doesn't influence anything by very much.
Another trick I derived from this comfort is to almost never actually condition on small-probability events. Instead, the better thing to do is to modify the random variables you care about to fail catastrophically in the small probability scenario.
For example, in graph theory I mig... (read more)