[This contains spoilers for the show The Sopranos.]
In the realm of epistemics, it is a sin to double-count evidence. From One Argument Against An Army:
I talked about a style of reasoning in which not a single contrary argument is allowed, with the result that every non-supporting observation has to be argued away. Here I suggest that when people encounter a contrary argument, they prevent themselves from downshifting their confidence by rehearsing already-known support.
Suppose the country of Freedonia is debating whether its neighbor, Sylvania, is responsible for a recent rash of meteor strikes on its cities. There are several pieces of evidence suggesting this: the meteors struck cities close to the Sylvanian border; there was unusual activity in the Sylvanian stock markets before the strikes; and the Sylvanian ambassador Trentino was heard muttering about “heavenly vengeance.”
Someone comes to you and says: “I don’t think Sylvania is responsible for the meteor strikes. They have trade with us of billions of dinars annually.” “Well,” you reply, “the meteors struck cities close to Sylvania, there was suspicious activity in their stock market, and their ambassador spoke of heavenly vengeance afterward.” Since these three arguments outweigh the first, you keep your belief that Sylvania is responsible—you believe rather than disbelieve, qualitatively. Clearly, the balance of evidence weighs against Sylvania.
Then another comes to you and says: “I don’t think Sylvania is responsible for the meteor strikes. Directing an asteroid strike is really hard. Sylvania doesn’t even have a space program.” You reply, “But the meteors struck cities close to Sylvania, and their investors knew it, and the ambassador came right out and admitted it!” Again, these three arguments outweigh the first (by three arguments against one argument), so you keep your belief that Sylvania is responsible.
Indeed, your convictions are strengthened. On two separate occasions now, you have evaluated the balance of evidence, and both times the balance was tilted against Sylvania by a ratio of 3 to 1.
You encounter further arguments by the pro-Sylvania traitors—again, and again, and a hundred times again—but each time the new argument is handily defeated by 3 to 1. And on every occasion, you feel yourself becoming more confident that Sylvania was indeed responsible, shifting your prior according to the felt balance of evidence.
The problem, of course, is that by rehearsing arguments you already knew, you are double-counting the evidence. This would be a grave sin even if you double-counted all the evidence. (Imagine a scientist who does an experiment with 50 subjects and fails to obtain statistically significant results, so the scientist counts all the data twice.)
I had the thought that something similar probably applies to morality as well. I'm thinking of Tony Soprano.
People say that Soprano is an asshole. Some say he is a sociopath. I'm not sure where I stand. But I finished watching The Sopranos recently and one thought that I frequently had when he'd do something harmful is that his hand was kinda forced.
For example, there was a character in the show named Adriana. Adriana became an informant to the FBI at some point. When Tony learned this, he had her killed.
Having someone killed is, in some sense, bad. But did Tony have a choice? If he didn't she very well could have gotten Tony and the rest of the mob members sent to jail, or perhaps sentenced to the death penalty. When that is the calculus, we usually don't expect the person in Tony's shoes to prioritize the person in Adriana's shoes.
It makes me think back to when I played poker. Sometimes you end up in a bad spot. It looks like you just don't have any good options. Folding seems too nitty. Calling is gross. Raising feels dubious. No move you make will end well.
But alas, you do in fact have to make a decision. The goal is not necessarily to find a move that will be good in an absolute sense. It's to make the best move relative to the other moves you can make. To criticize someone who chooses the best move in a relative sense because it is a bad move in an absolute sense is unfair. You have to look at it from the point-of-decision.
Of course, you also want to look back at how you got yourself in the bad spot in the first place. Like if you made a bad decision on the flop that put you in a bad spot on the turn, you want to call out the play you made on the flop as bad and learn from it. But you don't want to "double count" the move you made on the flop once you've moved on to analyzing the next street.
Using this analogy, I think Tony Soprano made some incredibly bad preflop moves that set himself up for a shit show. And then he didn't do himself any favors on the flop. But once he was on later streets like the turn and river, I'm not sure how bad his decisions actually were. And more generally, I think it probably makes sense to avoid "double counting" the mistakes people made on earlier streets when they are faced with decisions on later streets.
I spent the day browsing the website of Josh W. Comeau yesterday. He writes educational content about web development. I am in awe.
For so many reasons. The quality of the writing. The clarity of the thinking. The mastery of the subject matter. The metaphors. The analogies. The quality and attention to detail of the website itself. Try zooming in to 300%. It still look gorgeous.
One thing that he's got me thinking about is the place that sound effects and animation have on a website. Previously my opinion was that you should usually just leave 'em out. Focus on more important things. It's hard to implement them well; they usually just make the site feel tacky. They also add a decent amount of complexity.
But Josh does such a good job of utilizing sound effects and animation! Try clicking one of the icons on the top right. Or moving your cursor around those dots at the top of the home page. Or clicking the "heart" button at the end of the "Table of contents" section for one of his posts. It's so satisfying.
I'm realizing that my previous opinion was largely a cached thought. When I think about it now, I arrive at a different perspective. Right now I'm suspecting that both sound effects and animations should be treated as something to aspire towards. If it's a smaller-scale site and you don't have the skills or the resources to incorporate them, that's ok. But if it's a larger-scale site, I dunno, I feel like it's often worth prioritizing.
Anyway, the main thing I want to talk about is his usage of demos that you can explore. For example, check out his demos of how the flex-grow
property works. It's one thing to read the docs. It's another to see a visualization. It's another to play with a demo. They say that a picture is worth a thousand words. How many words is an interactive demo worth?
I don't think such demos always add that much value. Like for flex-grow
, I think it adds some value, but not too much compared to a visualization like the one here. On the other hand, the demo for content vs items actually made the concept click for me in a way that I don't think would have without the demo. It makes me think back to Explorable Explanations along with some of the other work of Bret Victor.
So yeah, sometimes demos really do add a lot of educational value. But even when they don't, I think that they can also add a lot of value in other ways. For example, by being engaging, or by providing delight.
This all makes me wonder about how worthwhile it is for writers to try to incorporate such interactive demos into their posts. I'm coming from a place where I'm thinking about the fact that they often add a lot of value. Yes, they're also pretty costly, but if they add a lot of value, I dunno, maybe it's worth paying the cost. Or maybe it's worth figuring out a way to lower it. I'm also coming from a place where I observe that people will, at times, put a lot of effort into some sort of written material that they produce, rewriting it and revising it and whatnot.
Then again, it is pretty costly to incorporate such demos. You'd have to learn to code, and be pretty good at it. You'd have to develop a pretty strong intuition for good design. Those are skills that take years to learn. Maybe doing so is worthwhile if your main thing is writing or education, but otherwise, probably not.
Another thing you could do is pay someone who has those skills. Again, doing so is going to be expensive. Maybe the cost is worth it for a large project like a book or something, but for something moreso on the scale of the blog post, probably not.
As a creative solution, I wonder whether it'd make sense to find young people earlier in their careers who have the needed skills and who are looking to get real world experience, make connections, and add to their resumes. Finding such people would probably be a decent amount of work though. Maybe if there was a platform to help? Meh. I feel cynical. Fundamentally, you're trying to get valuable, skilled labor for free. Feels too much like an uphill battle.
I suppose that like all things you could just point to the fact that AI will be good enough to do this sort of thing at some point. However, I don't think that observation is a helpful one. The conversation here is about how to improve content that you produce via interactive demos. Once AI is good enough to freely or cheaply produce those demos, it'll also be good enough to just produce the overall content.
What about people like me? I like to write. I want to produce good content. I am a front end leaning web developer. I think I have an eye for design. Maybe I am the type of person who could take the time and produce these sorts of interactive demos for the content I produce?
Nah. I don't think it'd be practical. Right now I have other things aside from writing that I'm prioritizing and I'm not looking to spend more than something on the scale of hours for a given post. At other points I aimed to spend something more on the scale of days for a given post, but even that is probably too short of a time scale to justify interactive demos. I think interactive demos become relevant when you're dealing with weeks, if not months. And so even if you have the skills, I think it often isn't practical if you aren't eg. a book author or something.
Maybe there is a deeper issue here. Maybe it's that we are the kind that can't cooperate. From a God's Eye perspective, I feel like I'd much prefer to take 100 authors and have them coordinate to produce 1 amazing blog post than for them to go off on their own and produce 100 mediocre blog posts. But observing this is hardly a solution. If we were able to solve this problem of a lack of cooperation it'd have impacts far beyond explorable explanations.
So overall, I guess I'm not really seeing anything actionable here with respect to the interactive demos.
I just came across That's Not an Abstraction, That's Just a Layer of Indirection on Hacker News today. It makes a very similar point that I make in this post, but adds a very helpful term: indirection. When you have to "open the box", the box serves as an indirection.
When I was a student at Fullstack Academy, a coding bootcamp, they had us all do this (mapping it to the control key), along with a few other changes to such settings like making the key repeat rate faster. I think I got this script from them.
My instinct is that it's not the type of thing to hack at with workarounds without buy in from the LW team.
If there was buy in from them I expect that it wouldn't be much effort to add some sort of functionality. At least not for a version one; iterating on it could definitely take time, but you could hold off on spending that time iterating if there isn't enough interest, so the initial investment wouldn't be high effort.
I think this is a great idea, at least in the distillation aspect.
Thanks!
Having briefer statements of the most important posts would be very useful in growing the rationalist community.
I think you're right, but I think it's also important to think about dilution. Making things lower-effort and more appealing to the masses brings down the walls of the garden, which "dilutes" things inside the garden.
But I'm just saying that this is a consideration. And there are lots of considerations. I feel confused about how to enumerate through them, weigh them, and figure out which way the arrow points: towards being more appealing to the masses or less appealing. I know I probably indicated that I lean towards the former when I talked about "summaries, analyses and distillations" in my OP, but I want to clarify that I feel very uncertain and if anything probably lean towards the latter.
But even if we did want to focus on having taller walls, I think the "more is possible" point that I was ultimately trying to gesture at in my OP still stands. It's just that the "more" part might mean things like coming up with things like higher quality explanations, more and better examples of what the post is describing, knowledge checks, and exercises.
Since we don't currently have that list of distilled posts (AFAIK - anyone?)
There is the Sequence Highlights which has an estimated reading time of eight hours.
Sometimes when I'm reading old blog posts on LessWrong, like old Sequence posts, I have something that I want to write up as a comment, and I'm never sure where to write that comment.
I could write it on the original post, but if I do that it's unlikely to be seen and to generate conversation. Alternatively, I could write it on my Shortform or on the Open Thread. That would get a reasonable amount of visibility, but... I dunno... something feels defect-y and uncooperative about that for some reason.
I guess what's driving that feeling is probably the thought that in a perfect world conversations about posts would happen in the comments section of the post, and by posting elsewhere I'm contributing to the problem.
But now that I write that out I'm feeling like that's a bit silly thought. Fixing the problem would take a larger concentration of force than just me posting a few comments on old Sequence posts once in a while. By me posting my comments in the comments sections of the corresponding post, I'm not really moving the needle. So I don't think I endorse any feelings of guilt here.
I would like to see people write high-effort summaries, analyses and distillations of the posts in The Sequences.
When Eliezer wrote the original posts, he was writing one blog post a day for two years. Surely you could do a better job presenting the content that he produced in one day if you, say, took four months applying principles of pedagogy and iterating on it as a side project. I get the sense that more is possible.
This seems like a particularly good project for people who want to write but don't know what to write about. I've talked with a variety of people who are in that boat.
One issue with such distillation posts is discoverability. Maybe you write the post, it receives some upvotes, some people see it, and then it disappears into the ether. Ideally when someone in the future goes to read the corresponding sequence post they would be aware that your distillation post is available as a sort of sister content to the original content. LessWrong does have the "Mentioned in" section at the bottom of posts, but that doesn't feel like it is sufficient.
I recently started going through some of Rationality from AI to Zombies again. A big reason why is the fact that there are audio recordings of the posts. It's easy to listen to a post or two as I walk my dog, or a handful of posts instead of some random hour-long podcast that I would otherwise listen to.
I originally read (most of) The Sequences maybe 13 or 14 years ago when I was in college. At various times since then I've made somewhat deliberate efforts to revisit them. Other times I've re-read random posts as opposed to larger collections of posts. Anyway, the point I want to make is that it's been a while.
I've been a little surprised in my feelings as I re-read them. Some of them feel notably less good than what I remember. Others blow my mind and are incredible.
The Mysterious Answers sequence is one that I felt disappointed by. I felt like the posts weren't very clear and that there wasn't much substance. I think the main overarching point of the sequence is that an explanation can't say that all outcomes are equally probable. It has to say that some outcomes are more probable than others. But that just seems kinda obvious.
I think it's quite plausible that there are "good" reasons why I felt disappointed as I re-read this and other sequences. Maybe there are important things that are going over my head. Or maybe I actually understand things too well now after hanging around this community for so long.
One post that hit me kinda hard that I really enjoyed after re-reading it was Rationality and the English Language, and then the follow up post, Human Evil and Muddled Thinking. The posts helped me grok how powerful language can be.
If you really want an artist’s perspective on rationality, then read Orwell; he is mandatory reading for rationalists as well as authors. Orwell was not a scientist, but a writer; his tools were not numbers, but words; his adversary was not Nature, but human evil. If you wish to imprison people for years without trial, you must think of some other way to say it than “I’m going to imprison Mr. Jennings for years without trial.” You must muddy the listener’s thinking, prevent clear images from outraging conscience. You say, “Unreliable elements were subjected to an alternative justice process.”
I'm pretty sure that I read those posts before, along with a bunch of related posts and stuff, but for whatever reason the re-read still meaningfully improved my understand the concept.
The central claim that "almost all growth is exponential growth" is an interesting one. However, I am not really seeing that this post makes an argument for it. It feels more like it is just stating it as a claim.
I would expect an argument to be something like "here is some deep principle that says that growth is almost always in proportion to the thing's current size". And then to give a bunch of examples of this being the case in various domains. (I found the examples in the opening paragraph to be odd. Bike 200 miles a week or never? Huh?) I also think it'd be helpful to point out counterexamples and spend some time commenting on them.