217

LESSWRONG
LW

HomeAll PostsConceptsLibrary
Best of LessWrong
Sequence Highlights
Rationality: A-Z
The Codex
HPMOR
Community Events
Subscribe (RSS/Email)
LW the Album
Leaderboard
About
FAQ
Customize
Load More

Quick Takes

Your Feed
Load More

Popular Comments

Hammertime

Thirty days of instrumental rationality practice exercises. Inspired by user 
Alkjash's experience with the Center for Applied Rationality.

Raemon2d*8243
Heroic Responsibility
I think this part of Heroic Responsibility isn't too surprising/novel to people. Obviously the business owner has responsibility for the business. The part that's novel is more like: If I'm some guy working in legal, and I notice this hot potato going around, and it's explicitly not my job to deal with it, I might nonetheless say "ugh, the CEO is too busy to deal with this today and it's not anyone else's job. I will deal with it." Then you go to each department head, even if you're not even a department head you're a lowly intern (say), and say "guys, I think we need to decide who's going to deal with this." And if their ego won't let them take advice from an intern, you might also take it as your responsibility to figure out how to navigate their ego – maybe by making them feel like it was their own idea, or by threatening to escalate to the CEO if they don't get to it themselves, or by appealing to their sense of duty. A great example of this, staying with them realm of "random Bureaucracy", I got from @Elizabeth: E. D. Morel was a random bureaucrat at a shipping company in 1891. He noticed that his company was shipping guns and manacles into the Congo, and shipping rubber and other resources back out to Britain. It was not Morel's job to notice that this was a bit weird. It was not Morel's job to notice that that weirdness was a clue, and look into those clues. And then find out that what was happening was, weapons were being sent to the Congo to forcibly steal resources at gunpoint. It was not his job to make it his mission to raise awareness of the Congo abuses and stop them. But he did. ... P.S. A failure mode of rationalists is to try to take Heroic responsibility for everything, esp. in a sort of angsty way that is counterproductive and exhausting. It's also a failure mode to act as if only you can possibly take Heroic responsibility, rather than trying to model the ecosystem around you and the other actors (some of whom might be Live Players who are also taking Heroic Responsibility, some of whom might be sort of local actors following normal incentives but are still, like, part of the solution) There is nuance to when and how to do Heroic Responsibility well.
niplav6h*260
People Seem Funny In The Head About Subtle Signals
Hm, I am unsure how much to believe this, even though my intuitions go the same way as yours. As a correlational datapoint, I tracked my success from cold approach and the time I've spent meditating (including a 2-month period of usually ~2 hours of meditation/day), and don't see any measurable improvement in my success rate from cold approach: (Note that the linked analysis also includes a linear regression of slope -6.35e-08, but with p=0.936, so could be random.) In cases where meditation does stuff to your vibe-reading of other people, I would guess that I'd approach women who are more open to being approached. I haven't dug deeper into my fairly rich data on this, and the data doesn't include much post-retreat approaches, but I still find the data I currently have instructive. I wish more people tracked and analyzed this kind of data, but I seem alone in this so far. I do feel some annoyance at everyone (the, ah, "cool people"?) in this area making big claims (and sometimes money off of those claims) without even trying to track any data and analyze it, leaving it basically to me to scramble together some DataFrames and effect sizes next to my dayjob.[1] > So start meditating for an hour a day for 3 months using the mind illuminated as an experiment (getting some of the cool skills mentioned in Kaj Sotala's sequence?) and see what happens? Do you have any concrete measurable predictions for what would happen in that case? ---------------------------------------- 1. I often wonder if empiricism is just incredibly unintuitive for humans in general, and experimentation and measurement even more so. Outside the laboratory very few people do it, and see e.g. Aristotle's claims about the number of women's teeth or his theory of ballistics, which went un(con)tested for almost 2000 years? What is going on here? Is empiricism really that hard? Is it about what people bother to look at? Is making shit up just so much easier so that everyone keeps in that mode, which is a stable equilibrium? ↩︎
Raemon3d*9773
The Tale of the Top-Tier Intellect
Serious question: (well, it'll start as "more of a comment, really", but, at the end I do have a question) The comment: I think the world is bottlenecked on people understanding the sort of concepts in posts like these. I don't think the world is particularly bottlenecked on current-gen-Yudkowsky-shaped dialogue essays about it. They appeal to a small set of people.  My guess is you write them anyway because they are pretty easy to write in your default style and maybe just mostly fun-for-their-own-sake. And when you're in higher-effort modes, you do also write things like If Anyone Builds It, that are shaped pretty different. And, probably these essays still help some people, and maybe they help workshop new analogies that eventually can be refined into If Anyone style books or podcast interviews. But, that said, my questions are: * How much have you experimented with finding low-energy-but-different formats, that might reroll on who finds them compelling? * (I'm particularly interested in if there turns out to be anything short in this reference class) * How much have you (or, anyone else, this doesn't have to be you) systematically thought about how to improve the distribution channel of this sort of essay so it reaches more people? Both of these are presumably high effort. I'm not sure if the the first one is a better use of your high-effort time than other things, or how likely it is to work out. But, wondering if this is an area you think you've already checked for low or mid-hanging fruit it. (Also, having now thought about it for 5 min, I think this sort of thing would actually make a good youtube video that the Rational Animations people might do. That could be mostly outsourced)
Load More
493Welcome to LessWrong!
Ruby, Raemon, RobertM, habryka
6y
76
[Today]AI Safety Thursday: Monitoring LLMs for deceptive behaviour using probes
[Tomorrow]EA/ACX meetup 7 November 2025 - Alternative proteins
Berkeley Solstice Weekend
2025 NYC Secular Solstice & East Coast Rationalist Megameetup
126
The Unreasonable Effectiveness of Fiction
Raelifin
17h
11
77
LLM-generated text is not testimony
TsviBT
4d
74
First Post: Hammers and Nails
255I ate bear fat with honey and salt flakes, to prove a point
aggliu
3d
34
203Legible vs. Illegible AI Safety Problems
Ω
Wei Dai
2d
Ω
45
740The Company Man
Tomás B.
1mo
70
680The Rise of Parasitic AI
Adele Lopez
2mo
177
77People Seem Funny In The Head About Subtle Signals
johnswentworth
17h
18
147What's up with Anthropic predicting AGI by early 2027?
ryan_greenblatt
3d
13
147Lack of Social Grace is a Lack of Skill
Screwtape
4d
21
180You’re always stressed, your mind is always busy, you never have enough time
mingyuan
5d
6
126The Unreasonable Effectiveness of Fiction
Raelifin
17h
11
133Publishing academic papers on transformative AI is a nightmare
Jakub Growiec
3d
6
230On Fleshling Safety: A Debate by Klurl and Trapaucius.
Eliezer Yudkowsky
11d
50
356Hospitalization: A Review
Logan Riggs
1mo
21
114Comparative advantage & AI
Simon Lermen
3d
25
Load MoreAdvanced Sorting/Filtering
Eric Neyman5h*5316
CounterBlunder, Zach Stein-Perlman
3
Nancy Pelosi is retiring; consider donating to Scott Wiener. [Link to donate; or consider a bank transfer option to avoid fees, see below.] Nancy Pelosi has just announced that she is retiring. Previously I wrote up a case for donating to Scott Wiener, an AI safety champion in the California legislature who is running for her seat, in which I estimated a 60% chance that Pelosi would retire. While I recommended donating on the day that he announced his campaign launch, I noted that donations would look much better ex post in worlds where Pelosi retires, and that my recommendation to donate on launch day was sensitive to my assessment of the probability that she would retire. I know some people who read my post and decided (quite reasonably) to wait to see whether Pelosi retired. If that was you, consider donating today! How to donate You can donate through ActBlue here (please use this link rather than going directly to his website, because the URL lets his team know that these are donations from people who care about AI safety). Note that ActBlue charges a 4% fee. I think that's not a huge deal; however, if you want to make a large contribution and are already comfortable making bank transfers, shoot be a DM and I'll give you instructions for making the bank transfer!
GradientDissenter14h629
Arjun Pitchanathan, Nina Panickssery, and 1 more
3
Notes on living semi-frugally in the Bay Area. I live in the Bay Area, but my cost of living is pretty low: roughly $30k/year. I think I live an extremely comfortable life. I try to be fairly frugal, both so I don't end up dependent on jobs with high salaries and so that I can donate a lot of my income, but it doesn't feel like much of a sacrifice. Often when I tell people how little I spend, they're shocked. I think people conceive of the Bay as exorbitantly expensive, and it can be, but it doesn't have to be. Rent: I pay ~$850 a month for my room. It's a small room in a fairly large group house I live in with nine friends. It's a nice space with plenty of common areas and a big backyard. I know of a few other places like this (including in even pricier areas like Palo Alto). You just need to know where to look and to be willing to live with friends. On top of rent I pay ~$200/month for things like utilities, repairs on the house, and keeping the house tidy. I pool the grocery bill with my housemates so we can optimize where we shop a little. We also often cook for each other (notably most of us, including myself, also get free meals on weekdays in the offices we work from, though I don't think my cost of living was much higher when I was cooking for myself each day not that long ago). It works out to ~$200/month. I don't buy that much stuff. I thrift most of my clothes, but I buy myself nice items when it matters (for example comfy, somewhat-expensive socks really do make my day better when I wear them). I have a bunch of miscellaneous small expenses like my Claude subscription, toothpaste, etc, but they don't add up to much. I don't have a car, a child, or a pet (but my housemate has a cat, which is almost the same thing). I try to avoid meal delivery and Ubers, though I use them in a pinch. Public transportation costs aren't nothing, but they're quite manageable. I actually have a PA who helps me with some personal accounting matters that I'm particularly
Viliam5h156
Seth Herd
1
I am fascinated by how often I read something about LLMs and it seems to illustrate something about human psychology. I wonder how many psychologists think about these things. (I suspect not many, because psychologists typically don't read technical articles about LLMs.) For example, in "GDM: Consistency Training Helps Limit Sycophancy and Jailbreaks in Gemini 2.5 Flash" the part "Bias-augmented Consistency Training", specifically "Train the model via SFT to give the clean response ... when shown the wrapped prompt"... that reminds me strongly of "Asch’s Conformity Experiment", "On Expressing Your Concerns". Specifically that it becomes much easier to resist pressure when you have seen an example of resisting the pressure.
Mateusz Bagiński8h120
0
In his MLST podcast appearance in early 2023, Connor Leahy describes Alfred Korzybski as a sort of "rationalist before the rationalists": Korzybski's two published books are Manhood of Humanity (1921) and Science and Sanity (1933). Having read the book (and having filtered it through some of my own interpretaion of it and perhaps some steelmanning) I am inclined to interpret his "time-binding" as something like (1) accumulation of knowledge from past experience across time windows that are inaccessible to any other animals (both individual (long childhoods) and cultural learning); and (2) the ability to predict and influence the future. This gets close in the neighborhood of "agency as time-travel", consequentialist cognition, etc. In the wiki page of his other book: (But that is relatively well-known.) As Connor said... ...but 60 years later, his project would be restarted. ---------------------------------------- See also: https://www.lesswrong.com/posts/qc7P2NwfxQMC3hdgm/rationalism-before-the-sequences 
GradientDissenter3d9014
gjm, noahzuniga, and 3 more
6
Here's my attempt at a neutral look at Prop 50, which people in California can vote on Tuesday (Nov 4th). The bill seems like a case-study in high-stakes game theory and when to cooperate or defect. The bill would allow the CA legislature to re-write the congressional district maps until 2030 (when district-drawing would go back to normal). Currently, the district maps are drawn by an independent body designed to be politically neutral. In essence, this would allow the CA legislature to gerrymander California. That would probably give Democrats an extra 3-5 seats in Congress. It seems like there's a ~17% chance that it swings the House in the midterms. Gerrymandering is generally agreed to be a bad thing, since it means elections are determined on the margin more by the map makers and less by the people. The proponents of this bill don't seem to think otherwise. They argue the bill is in response to Texas passing a similar bill to redistrict in a way that is predicted to give Republicans 5 new house seats (not to mention similar bills in North Carolina and Missouri that would give republicans an additional 2 seats). Trump specifically urged Texas, North Carolina, and Missouri to pass their bills, and the rationale was straightforwardly to give Republicans a greater chance at winning the midterms. For example, Rep. Todd Hunter, the author of Texas's redistricting bill, said "The underlying goal of this plan is straightforward, [to] improve Republican political performance". Notably some Republicans have also tried to argue that the Texas bill is in response to Democrats gerrymandering and obstructionism, but this doesn't match how Trump seems to have described the rationale originally.[1] The opponents of Prop 50 don't seem to challenge the notion that the Republican redistricting was bad.[2] They just argue that gerrymandering is bad for all the standard reasons. So, it's an iterated prisoners' dilemma! Gerrymandering is bad, but the Republicans did it, maybe
J Bostock7h90
Daniel C, testingthewaters
2
Steering as Dual to Learning I've been a bit confused about "steering" as a concept. It seems kinda dual to learning, but why? It seems like things which are good at learning are very close to things which are good at steering, but they don't always end up steering. It also seems like steering requires learning. What's up here? I think steering is basically learning, backwards, and maybe flipped sideways. In learning, you build up mutual information between yourself and the world; in steering, you spend that mutual information. You can have learning without steering---but not the other way around---because of the way time works. This also lets us map certain things to one another: the effectiveness of methods like monte-carlo tree search (i.e. calling your world model repeatedly to form a plan) can be seen as dual to the effectiveness of things like randomized controlled trials (i.e. querying the external world repeatedly to form a good model).
Tomás B.2d5549
interstice, Ryan Meservey, and 12 more
19
Tallness is zero sum. But I suspect beauty isn't. If everyone was more beautiful but the relative differences remained, I think people would be happier. Am I wrong in this? This has policy implications, as once genetic engineering gets better taxing height is likely wise to avoid red-queens races into unhealthy phenotypes. Taxing beauty seems very horrible to me. As beauty is quite beautiful. 
Load More (7/60)