DanielFilan's Shortform Feed

by DanielFilan1 min read25th Mar 201985 comments
Crossposted from the AI Alignment Forum. May contain more technical jargon than usual.

Rationality-related writings that are more comment-shaped than post-shaped. Please don't leave top-level comments here unless they're indistinguishable to me from something I would say here.

85 comments, sorted by Highlighting new comments since Today at 10:17 PM
New Comment
Some comments are truncated due to high volume. (⌘F to expand all)Change truncation settings

Hot take: if you think that we'll have at least 30 more years of future where geopolitics and nations are relevant, I think you should pay at least 50% as much attention to India as to China. Similarly large population, similarly large number of great thinkers and researchers. Currently seems less 'interesting', but that sort of thing changes over 30-year timescales. As such, I think there should probably be some number of 'India specialists' in EA policy positions that isn't dwarfed by the number of 'China specialists'.

For comparison, in a universe where EA existed 30 years ago we would have thought it very important to have many Russia specialists.

6DanielFilan6moJust learned that 80,000 hours' career guide includes [https://80000hours.org/key-ideas/#other-paths] the claim that becoming a Russia or India specialist might turn out to be a very promising career path.
5Adam Scholl1yI've been wondering recently whether CFAR should try having some workshops in India for this reason. Far more people speak English than in China, and I expect we'd encounter fewer political impediments.
5lifelonglearner1yAlso, anecdotally, there have been lots of Indian applicants (and attendees) at ESPR throughout the years. Seems like people there also think rationality is cool (lots of the people I interviewed had read HPMOR, there are LW meetups there, etc. etc.)
2Raemon1yAlso fyi, a nontrivial fraction of new users on LessWrong have Indian sounding usernames.
3Linch3moBrazil is another interesting place. In addition to the large populations and GDP, anecdotally based on online courses I've taken, philosophy meme groups etc, Brazilians seem more interested in Anglo-American academic ethics than people from China or India, despite the presumably large language barrier.
3mingyuan1yfwiw the global poverty part of EA already does a fair amount of work in India. I know EA is a bit (and increasingly) fragmented between different cause areas, but that still might be a useful entry point?

The Indian grammarian Pāṇini wanted to exactly specify what Sanskrit grammar was in the shortest possible length. As a result, he did some crazy stuff:

Pāṇini's theory of morphological analysis was more advanced than any equivalent Western theory before the 20th century. His treatise is generative and descriptive, uses metalanguage and meta-rules, and has been compared to the Turing machine wherein the logical structure of any computing device has been reduced to its essentials using an idealized mathematical model.

There are two surprising facts about this:

  1. His grammar was written in the 4th century BC.
  2. People then failed to build on this machinery to do things like formalise the foundations of mathematics, formalise a bunch of linguistics, or even do the same thing for languages other than Sanskrit, in a way that is preserved in the historical record.

I've been obsessing about this for the last few days.

Shower thought[*]: the notion of a task being bounded doesn't survive composition. Specifically, say a task is bounded if the agent doing it is only using bounded resources and only optimising a small bit of the world to a limited extent. The task of 'be a human in the enterprise of doing research' is bounded, but the enterprise of research in general is not bounded. Similarly, being a human with a job vs the entire human economy. I imagine keeping this in mind would be useful when thinking about CAIS.

Similarly, the notion of a function being interpretable doesn't survive composition. Linear functions are interpretable (citation: the field of linear algebra), as is the ReLU function, but the consensus is that neural networks are not, or at least not in the same way.

I basically wish that the concepts that I used survived composition.

[*] Actually I had this on a stroll.

3Raemon2yFwiw, this seems like an interesting thought but I'm not sure I understand it, and curious if you could say it in different words. (but, also, if the prospect of being asked to do that for your shortform comments feels ughy, no worries)
5DanielFilan2yOften big things are made of smaller things: e.g., the economy is made of humans and machines interacting, and neural networks are made of linear functions and ReLUs composed together. Say that a property P survives composition if knowing that P holds for all the smaller things tells you that P holds for the bigger thing. It's nice if properties survive composition, because it's easier to figure out if they hold for small things than to directly tackle the problem of whether they hold for a big thing. Boundedness doesn't survive composition: people and machines are bounded, but the economy isn't. Interpretability doesn't survive composition: linear functions and ReLUs are interpretable, but neural networks aren't.

I get to nuke LW today AMA.

I think the use of dialogues to illustrate a point of view is overdone on LessWrong. Almost always, the 'Simplicio' character fails to accurately represent the smart version of the viewpoint he stands in for, because the author doesn't try sufficiently hard to pass the ITT of the view they're arguing against. As a result, not only is the dialogue unconvincing, it runs the risk of misleading readers about the actual content of a worldview. I think this is true to a greater extent than posts that just state a point of view and argue against it, because the dialogue format naively appears to actually represent a named representative of a point of view, and structurally discourages disclaimers of the type "as I understand it, defenders of proposition P might state X, but of course I could be wrong".

3Dagon8moI've seen such dialogs, and felt exactly the same way. At least twice I've later found out that the dialog actually happened and there was no misrepresentation or simplification, just a HUGE inferential distance about what models of the universe (really, models of groups of people are the main sticking points) should be applied in what circumstances.
2Matt Goldenberg9moPossibly this could also be a strength, because by representing the views separately like that it makes it easier to see exactly what assumptions are causing them to fail the ITT. On the other hand if they're sufficiently far off, the dialogue basically goes off in the entirely wrong direction.
1Mark Xu8moDo you have examples of dialogues that fail to pass the ITT? I'm curious if you think any of the dialogues I've read might have been misleading.

A bunch of my friends are very skeptical of the schooling system and promote homeschooling or unschooling as an alternative. I see where they're coming from, but I worry about the reproductive consequences of stigmatising schooling in favour of those two alternatives. Based on informal conversations, the main reason why people I know aren't planning on having more children is the time cost. A move towards normative home/unschooling would increase the time cost of children, and as such make them less appealing to prospective parents[*]. This in turn would reduce birth rates, worsening the problem that first-world countries face in the next couple of decades of a low working-age:elderly population ratio [EDIT: also, low population leading to less innovation, also low population leading to fewer people existing who get to enjoy life]. As such, I tentatively wish that home/unschooling advocates would focus on more institutional ways of supervising children, e.g. Sudbury schools, community childcare, child labour [EDIT: or a greater emphasis on not supervising children who don't need supervision, or similar things].

[*] This is the weakest part of my argument - it's possible that more people home/unschooling their kids would result in cooler kids that were more fun to be around, and this effect would offset the extra time cost (or kids who are more willing to support their elderly parents, perhaps). But given how lucrative the first world labour market is, I doubt it.

9Isnasene1yWhile I agree that a world where home/un-schooling is a norm would result in greater time-costs and a lower child-rate, I don't think that promoting home/un-schooling as an alternative will result in a world where home/un-schooling is normative. Because of this, I don't think that promoting home/un-schooling as an alternative to the system carries any particularly broad risks. Here's my reasoning: * I expect the associated stigmas and pressures for having kids to always dwarf the associated stigmas and pressures against having kids if they are not home/un-schooled. Having kids is an extremely strong norm both because of the underpinning evolutionary psychology and because a lot of life-style patterns after thirty are culturally centered around people who have kids. * Despite its faults, public school does the job pretty well for most of people. This applies to the extent that the opportunity cost of home/un-schooling instead of building familial wealth probably outweighs the benefits for most people. Thus, I don't believe that the promoting of home/un-schooling is scaleable to everyone. * Lots of rich people who have the capacity to home/un-school who dislike the school system decide not to do that. Instead they (roughly speaking) coordinate towards expensive private schools outside the public system. I doubt that this has caused a significant number of people to avoid having children for fear of not sending them to a fancy boading school. * Even if the school system gets sufficiently stigmatised, I actually expect that the incentives will naturally align around institutional schooling outside the system for most children. Comparative advantages exist and local communities will exploit them. * Home/un-schooling often already involves institutional aspects. Explicitly, home/un-schooled kids would ideally have outlets for peer-to-peer interactions during the school-day and these are often satisfied through
6DanielFilan1yDeveloped countries already have below-replacement fertility (according to this NPR article [https://www.npr.org/2019/05/15/723518379/u-s-births-fell-to-a-32-year-low-in-2018-cdc-says-birthrate-is-at-record-level] , the CDC claims that the US has been in this state since 1971), so apparently you can have pressures that outweigh pressures to have children. In general I don't understand why you don't think that a marginal increase in the pressure to invest in each kid won't result in marginally fewer kids. Presumably this is not true in a world where many people believe that schools are basically like prisons for children, which is a sentiment that I do see and seems more memetically fit than "homeschooling works for some families but not others". My impression was that rich people often dislike the public school system, but are basically fine with schools in general? Rich people have fewer kids than poor people [https://www.statista.com/statistics/241530/birth-rate-by-family-income-in-the-us/] and it doesn't seem strange to me to imagine that that's partly due to the fact that each child comes at higher expected cost. This seems right to me barring strong normative home/unschooling, and I wish that this were a more promoted alternative (as my post mentions!). Yep - you'll notice that my post doesn't deny the manifold benefits of the home/unschooling movement, and I think the average unschooling advocate is basically right about how bad typical schools are.
1Isnasene1yI think the crux of our perspective difference is that we model the decrease in reproduction differently. I tend to view poor people and developing countries having higher reproduction rates as a consequence of less economic slack. That is to say, people who are poorer have more kids because those kids are decent long-term investments overall (ie old-age support, help-around-the-house). In contrast, wealthy people can make way more money by doing things that don't involve kids. This can be interpreted in two ways: * Wealthier people see children as higher cost and elect not to have children because of the costs or * Wealthier people are not under as much economic pressure so have fewer children because they can afford to get away with it At the margin, both of these things are going on at the same time. Still, I attribute falling birthrates as mostly due to the latter rather than the former. So I don't quite buy the claim that falling birth-rates have been dramatically influenced by greater pressures. Of course, Wei Dai indicates that parental investment definitely has an effect so maybe my attribution isn't accurate. I'd be pretty interested in seeing some studies/data trying to connect falling birthrates to the cultural demands around raising children. ... Also, my understanding of the pressures re:homeschooling is something like this: * The social stigma against having kids is satisficing. Having one kid (below replacement level) hurts you dramatically less than having zero kids * The capacity to home-school is roughly all-or-nothing. Home-schooling one kid immediately scales to home-schooling all your kids. * I doubt the stigma for schooling would punish a parent who sends two kids to school more than a parent who sends one kid to school This means that, for a given family, you essentially chose between having kids and home-schooling all of them (expected-cause of home-schooling doesn't scale with number of children) or having no
2cousin_it1yKids will grow up and move away no matter if you're rich or poor though, so I'm not sure the investment explanation makes sense. But your last sentence rings true to me. If someone cares more about career than family, they will always have "no time" for a family. I've heard it from well-paid professionals many times: "I'd like to have kids... eventually..."
2Wei_Dai1yI think you're overstating the stigma against not having kids. I Googled "is there stigma around not having kids" and the top two US-based articles both say something similar: USA Today [https://www.usatoday.com/story/news/nation/2019/03/29/childfree-women-parenting-parenthood-no-kids/3153546002/] : Times [https://time.com/5492622/stephanie-zacharek-childless-life/]:
1Isnasene1yAgreed. Per my latest reply to DanielFilan: I massively underestimated the rate of childfree-ness and, broadly speaking, I'm in agreement with Daniel now.
2DanielFilan1y[next quote is reformatted so that I can make it a quote] Glad to see we agree - and again, the important point for my argument isn't whether most of existing low fertility can be attributed to the existing cost of kids, but whether adding extra cost per kid will reduce the number of kids (as the law of demand [https://en.wikipedia.org/wiki/Law_of_demand] predicts). I'm sure this can't be exactly right, but I do think that the low marginal cost of home-schooling was something I was missing. I continue to think that you aren't thinking on the margin, or making some related error (perhaps in understanding what I'm saying). Electing for no kids isn't going to become more costly, so if you make having kids more costly, then you'll get fewer of them than you otherwise would, as the people who were just leaning towards having kids (due to idiosyncratically low desire to have kids/high cost to have kids) start to lean away from the plan. (I assume you meant pressure in favour of home-schooling?) Please note that I never said it had a high effect relative to other things: merely that the effect existed and was large and negative enough to make it worthwhile for homeschooling advocates to change course.
1Isnasene1yYeah, I was thinking in broad strokes there. I agree that there is a margin at which point people switch from choosing to have kids to choosing not to have kids and that moving that margin to a place where having kids is less net-positive will cause some people to choose to have fewer kids. My point was that the people on the margin are not people who will typically say"well we were going to have two kids but now we're only going to have one because home-schooling"; they're people who will typically say "we're on the fence about having kids at all." Whereas most marginal effects relating to having kids (ie the cost of college) pertain to the former group, the bulk of marginal effects on reproduction pertaining to schooling stigmas pertain to the latter group. Both the margin and the population density at the margin matter in terms of determining the effect. What I'm saying is that the population density at the margin relevant to schooling-stigmas is notably small. However, I've actually been overstating my case here. The childfree rate in the US is currently around 15% [https://en.wikipedia.org/wiki/Voluntary_childlessness#Statistics_and_research] which is much larger than I expected. The childfree rate for women with above a bachelor's degree is 25% [https://en.wikipedia.org/wiki/Voluntary_childlessness#Education]. In absolute terms, these are not small numbers and I've gotta admit that this indicates a pretty high population density at the margin. Per the above stats, I've updated to agree with this claim.
4Wei_Dai1yThe trend in China of extreme parental investment (lots of extra classes starting from a young age, forcing one's kid to practice hours of musical instrument each week, paying huge opportunity costs to obtain a 学区房 [https://schott.blogs.nytimes.com/2009/07/21/xue-qu-fang/]) almost certainly contributes significantly to its current low birth rate [https://www.nytimes.com/2020/01/16/business/china-birth-rate-2019.html]. I think normative home/unschooling has the potential to have a similar influence elsewhere. But have you thought about whether lower birth rate is good or bad from a longtermist / x-risk perspective? It's not clear to me that it's bad, at least.
2DanielFilan1yI haven't thought incredibly carefully about this. My guess is that a high birth rate accelerates basically everything but elderly care, and so the first-order question is whether you think humanity is pushing in roughly the right or wrong direction - I'd say it's going in the right direction. That being said, there's also a trickier factor of whether you'd rather have all your cognition be in serial or in parallel, and if you want it to be in serial, then low birth rates look good.
5Wei_Dai1yA couple of considerations in the "lower birth rate is good for longtermism" direction: 1. Lower birth rate makes war less likely. (Less perceived need to grab other people's resources. Parents are loathe to lose their only children in war.) 2. Increased parental investment and inheritance which shifts up average per-capita human and non-human capital, which is probably helpful for increasing understanding of x-risk and ability/opportunity to work on it. (Although this depends on the details of how the parental investment is done, since some kinds, e.g., helicopter parenting, can be counterproductive. Home/unschooling seems likely to be good in this regard though.)
2DanielFilan1yOne factor here that is big in my mind: I expect per-capita wealth to be lower in worlds with lower populations, since fewer people means fewer ideas that enrich everyone. I think that this makes 2 go in the opposite direction, but it's not obvious to me what it does for 1.
0Dagon1yIt's not clear that positive-sum innovation is linear (or even monotonically positive) with total population. There almost certainly exist levels at which marginal mouths to feed drive unpleasant and non-productive behaviors more than they do the growth-driving shared innovations. Whether we're in a downward-sloping portion of the curve, and whether it slopes up again in the next few generations, are both debatable. And they should be debated.
6DanielFilan1yMy sense is that on average, more population means more growth (see this [https://www.jstor.org/stable/2118405?seq=1] study on the question). But certainly at some point probably you run out of ideas for how to make material more valuable and growth just becomes making more people with the same consumption per capita. I find this comment kind of irksome, because (a) neither I nor anybody else said that they weren't proper subjects for debate and (b) you've exhorted debate on the topic but haven't contributed anything other than the theoretical possibility that the effect could go the other way. So I see this as trying to advance some kind of point illegitimately. If you make another such comment that I find irksome in the same way, I'll delete it, as per my commenting guidelines.
2DanielFilan1yI now think the biggest flaw with this argument is that home/unschooling actually don't take that many hours out of the day, and there's a lot of pooling of work going on. Thanks to many FB commenters and Isnasene for pointing that out.
2DanielFilan1yAnd also that anti-standard-school memes are less fit than pro-home/unschooling memes, such that "normative home/unschooling" doesn't seem that likely to be a big thing.
1Pattern1ySo you're a proponent of improving institutional ways of supervising children?
2DanielFilan1yTentatively, yes. But I've only just had this thought today, so I'm not very committed to it. Also note my edit: it's more about being in favour of low-time-investment ways to raise children that don't have the problems schooling is alleged to have.

I often see (and sometimes take part in) discussion of Facebook here. I'm not sure whether when I partake in these discussions I should disclaim that my income is largely due to Good Ventures, whose money largely comes from Facebook investments. Nobody else does this, so shrug.

4Raemon2yHuh. Indeed seems good to at least have talked about talking about.

One result that's related to Aumann's Agreement Theorem is that if you and I alternate saying our posterior probabilities of some event, we converge on the same probability if we have common priors. You might therefore wonder why we ever do anything else. The answer is that describing evidence is strictly more informative than stating one's posterior. For instance, imagine that we've both secretly flipped coins, and want to know whether both coins landed on the same side. If we just state our posteriors, we'll immediately converge to 50%, without actually learning the answer, which we could have learned pretty trivially by just saying how our coins landed. This is related to the original proof of the Aumann agreement theorem in a way that I can't describe shortly.

On the most recent episode of the podcast Rationally Speaking, David Shor discusses how members of the USA's Democratic Party could perform better electorally by not talking about their unpopular extreme views, but notes that many individual Democrats have better lives by talking about their unpopular extreme views that are popular with left-wing activists (e.g. because they become more prominent and get to feel good about themselves), which cause some voters to associate those unpopular extreme views with the Democratic Party and not vote for them.

This is discussed as a sad irrationality that constitutes a coordination failure among Democrats, but I found that an odd tone. Part of the model in the episode is that Democratic politicians in fact have these unpopular extreme views, but it would hurt their electoral chances if that became known. From a non-partisan perspective, you'd expect it to be a good thing to know what elected officials actually think. Now, you might think that elected officials shouldn't enact the unpopular policies that they in fact believe in, but it's odd to me that they apparently can't credibly communicate that they won't enact those policies. At any rate, I'm a bit bothered by the idea of coordinated silence to ensure that people don't know what powerful people actually think being portrayed as good.

5Viliam19dThe episode is quite interesting! The system is set up in the way that before a Democratic candidate can enter their final battle against the Republican candidate, first they have to defeat their fellow Democrats. And things that help them in the previous rounds (talking like a SJW, to put it bluntly) seem to hurt them in the final round, and vice versa. The underlying reason is that within Democratic Party, the opinions of the vanguard got recently so far from the opinions of hoi polloi, that it became almost impossible for any candidate to make both happy. With the vanguard, you score by being extreme, by "pushing the Overton window". With hoi polloi, you score by being a relatable person, by (illusion of) caring about their boring everyday problems. (Followed by an interesting explanation why Republican Party doesn't have the symmetric problem. Within both parties, the more educated and more politically active people are more left-wing than their average voter. In Republican Party, this pushes the candidates towards center, making them more attractive for voters in general; in Democratic Party, this pushes the candidates away from center, making them less attractive for voters.) The part where I disagree with Julia's summary is that to Julia, if I understand her correctly, the vanguard is a more extreme version of hoi polloi. To me it seems like they often care about different things. Consider the television ads that were popular among elite Democrats, but actually made people more likely to vote for Republicans. I don't read this as "you represent my opinion too strongly", but rather as "you don't represent my opinion". David suggests an interesting solution: Democrats should have more non-white candidates with less woke opinions, because (these are my words) the vanguard will hesitate to attack them because of their color, and hoi polloi will find them more acceptable because of their opinions. (Kinda like Obama.) Cool trick, but I suspect it will st
7DanielFilan19dI think this is false. Shor, from the transcript: I don't have much to say about your take, but it was interesting!
3Viliam18dYou're right, the main difference is not between the primaries and the final round, but rather somewhere between Twitter/journalists and primaries.
4Unnamed1moIt seems clear that we want politicians to honestly talk about what they're intending to do with the policies that they're actively trying to change (especially if they have a reasonable chance of enacting new policies before the next election). That's how voters can know what they're getting. It's less obvious how this should apply to their views on things which aren't going to be enacted into policy. Three lines of thinking that point in the direction of maybe it's good for politicians to keep quiet about (many of) their unpopular views: It can be hard for listeners to tell how likely the policy is to be enacted, or how actively the politician will try to make it happen. I guess it's hard to fit into 5 words? e.g. I saw a list of politicians' "broken promises" on one of the fact checking sites, which was full of examples where the politician said they were in favor of something and then it didn't get enacted, and the fact checkers deemed that sufficient to count it as a broken promise. This can lead to voters putting too little weight on the things that they're actually electing the politician to do, e.g. local politics seems less functional if local politicians focus on talking about their views on national issues that they have no control over. Another issue is that it's cheap talk. The incentive structure / feedback loops seem terrible for politicians talking about things unrelated to the policies they're enacting or blocking. Might be more functional to have a political system where politicians mostly talk about things that are more closely related to their actions, so that their words have meaning that voters can see. Also, you can think of politicians' speech as attempted persuasion. You could think of voters as picking a person to go around advocating for the voters' hard-to-enact views (as well as to implement policies for the voters' feasible-to-enact views). So it seems like it could be reasonable for voters to say "I think X is bad, so I'm not going
2DanielFilan1moNote that the linked podcast is not merely arguing that politicians should keep quiet about their views, it's also arguing that their fellow partisans in e.g. think-tanks and opinion sections should also keep quiet, because people can tell that the politicians secretly believe what the think-tankers and opinionists openly say. I think these arguments don't imply that those think-tankers and opinionists should keep quiet.
1Liam Donovan18dShor is very open about the fact that his views are to the left of 90%+ of the electorate, and that his goal is to maximize the power of people that share his views despite their general unpopularity.
3DanielFilan18dYeah, I think I'm more surprised by Galef's tone than Shor's.

Models and considerations.

There are two typical ways of deciding whether on net something is worth doing. The first is to come up with a model of the relevant part of the world, look at all the consequences of doing the thing in the model, and determine if those consequences are net positive. When this is done right, the consequences should be easy to evaluate and weigh off against each other. The second way is to think of a bunch of considerations in favour of and against doing something, and decide whether the balance of considerations supports doing the thing or not.

I prefer model-building to consideration-listing, for the following reasons:

  • By building a model, you're forcing yourself to explicitly think about how important various consequences are, which is often elided in consideration-listing. Or rather, I don't know how to quantitatively compare importances of considerations without doing something very close to model-building.
  • Building a model lets you check which possible consequences are actually likely. This is an improvement on considerations, which are often of the form "such-and-such consequence might occur".
  • Building a model lets you notice consequences which you m
... (read more)
4DanielFilan4moHomework: come up with a model of this.

Hot take: the norm of being muted on video calls is bad. It makes it awkward and difficult to speak, clap, laugh, or make "I'm listening" sounds. A better norm set would be:

  • use zoom in gallery mode, so somebody making noise doesn't make them more focussed than they were before
  • call from a quiet room
  • be more tolerant of random background sounds, the way we are IRL
1Pongo8moAgreed. I often find myself unmuting because I'm trying to make social sounds (often laughter). However, in a large conversation, I prefer someone becomes a weird void without backchannel sounds than be plunged into domestic mayhem

A rough and dirty estimate of the COVID externality of visiting your family in the USA for Christmas when you don't feel ill [EDIT: this calculation low-balls the externality, see below]:

You incur some number of μCOVIDs[*] a week, let's call it x. Since the incubation time is about 5 days, let's say that your chance of having COVID is about 5x/7,000,000 when you arrive at the home of your family with n other people. In-house attack rate is about 1/3, I estimate based off hazy recollections, so in expectation you infect 5xn/21,000,000 people, which is about... (read more)

4DanielFilan1moI recently realized, thanks to a FB comment by Paul Christiano, that this is thinking about things in kind of the wrong way. R is approximately 1 because society is tamping down infection rates when infections are high and 'loosening' when infections are low. So, by infecting people, you cause some chain of counterfactual infections that perhaps ends when society notices and tamps down infection, but also you cause the rest of society to do less fun interacting in order to tamp down the virus. So the cost of infecting somebody is to cause everybody else to be more conservative. I'm still not quite sure how to think about that cost tho.
2DanielFilan2moNote: this calculation only accounts for you infecting your relatives who then infect others, and not your relatives infecting you and you infecting others. Accounting for this should probably raise the cost by a factor of 2.
2DanielFilan2moNote: this calculation assumes that travelling is not risky at all. Realistically that should be bundled into x.

Better to concretise 3 ways than 1 if you have the time.

Here's a tale I've heard but not verified: in the good old days, Intrade had a prediction market on whether Obamacare would become law, which resolved negative, due to the market's definition of Obamacare.

Sometimes you're interested in answering a vague question, like 'Did Donald Trump enact a Muslim ban in his first term' or 'Will I be single next Valentine's day'. Standard advice is to make the question more specific and concrete into something that can be more objectively evaluated. I think that th

... (read more)

This weekend, I looked up Benquo's post on zetetic explanation in order to nominate it for the 2019 review. Alas, it was posted in 2018, and wasn't nominated for that year's review. Nevertheless, I've recently gotten interested in amateur radio, and have noticed that the mechanistic/physical explanations of radio waves and such that I've come across while studying for exams are not really sufficient to empower me to actually get on the radio, and more zetetic explanations are useful, altho harder to test. Anyway, I recommend re-reading the post.

As far as I can tell, people typically use the orthogonality thesis to argue that smart agents could have any motivations. But the orthogonality thesis is stronger than that, and its extra content is false - there are some goals that are too complicated for a dumb agent to have, because the agent couldn't understand those goals. I think people should instead directly defend the claim that smart agents could have arbitrary goals.

Ted Kaczynski as a relatively apolitical test case for cancellation norms:

Ted Kaczynski was a mathematics professor who decided that industrial society was terrible, and waged a terroristic bombing campaign to foment a revolution against technology. As part of this campaign, he wrote a manifesto titled "Industrial Society and Its Future" and said that if a major newspaper printed it verbatim he would desist from terrorism. He is currently serving eight life sentences in a "super-max" security prison in Colorado.

My understanding is that his manifesto (which... (read more)

Generally speaking, if someone commits heinous and unambiguous crimes in service of an objective like "getting people to read X", and it doesn't look like they're doing a tricky reverse-psychology thing or anything like that, then we should not cooperate with that objective. If Kaczynski had posted his manifesto on LessWrong, I would feel comfortable deleting it and any links to it, and I would encourage the moderator of any other forum to do the same under those circumstances.

But this is a specific and unusual circumstance. When people try to cancel each other, usually there's no connection or a very tenuous connection between their writing and what they're accused of. (Also the crime is usually less severe and less well proven.) In that case, the argument is different; either the people doing the cancelling think that the crime wasn't adequately punished, and are trying to create justice via a distributed minor punishment. If people are right about whether the thing is bad, then the main issues are about standards of evidence (biased readings and out-of-context quotes go a long way), proportionality (it's not worth blowing up peoples' lives over having said something dumb on the internet), and relation to nonpunishers (problems happen when things escalate from telling people why someone is bad, to punishing people for not believing or not caring).

2Dagon3moThere's no need to cancel anyone who's failing to have influence already. I suspect there are no apolotical test cases: cancellation (in the form of verbally attacking and de-legitimizing someone as a person, rather than arguing against specific portions of their work) is primarily politically motivated. It's pretty pure ad-hominem argument: "don't listen to or respect this person, regardless of what they're saying". In this case, I'm not listening because I think it's low-value on it's own, regardless of authorship. The manifesto is pretty easy to find in PDF form for free. I wasn't able to get very far - way too many crackpot signals and didn't seem worth my time. To your bullet points: 1. I can read this two ways: "should anybody" meaning "do you recommend any specific person read it" or "do you object to people reading it". My answers are "yes, but not many people", and "no.". Anybody who is interested, either from a direct curiosity on the topic (which I predict won't be rewarded) or from wanting to understand this kind of epistemic pathology (which might be worthwhile) should read it. 2. It's absolutely acceptable. I wouldn't enjoy it, but I'm not a member of the group, so no harm there. To decide whether YOUR group should do it, try to identify what you'd hope to get out of it, and what likely consequences there are from pursuing that direction. If your group is visible and sensitive to public perception (aka politically influenced), then certainly you should consider those affects.
2DanielFilan3moTo be explicit, here are some reasons that the EA community should cancel Kaczynski. Note that I do not necessarily think that they are sound or decisive. * EAs are known as utilitarians who are concerned about the impact of AI technology. By associating with him, that could give people the false impression that EAs are in favour of terroristic bombing campaigns to retard technological development, which would damage the EA community. * His threat to bomb more people and buildings if the Washington Post (WaPo) didn't publish his manifesto damaged good discourse norms by inducing the WaPo to talk about something it wasn't otherwise inclined to talk about, and good discourse norms are important for effective altruism. * It seems to me (not having read the manifesto) that the policies he advocates would cause large amounts of harm. For instance, without modern medical technology, I and many others would not have survived to the age of one year. * His bombing campaign is evidence of very poor character.
2Pattern3mo1. Did a newspaper print it verbatim? 2. Did he desist? Did he start again later? 3. Who wrote these: "(which, incidentally, has been updated and given a new title "Anti-Tech Revolution: Why and How", the second edition of which was released this year)"? 4. How long is "eight life sentences", and how much time does he have left?
2DanielFilan3mo1. Yes, it was published by the Washington Post [https://en.wikipedia.org/wiki/Ted_Kaczynski#Industrial_Society_and_Its_Future] . 2. Yes, there were no further bombings after its publication. 3. He did. 4. "eight life sentences", IIUC, means that he will serve the rest of his life, and if the justice system decides that one (or any number less than 8) of the sentences should be vacated, he will still serve the rest of his life. I'm not sure what his life expectancy is, but he's 78 at the moment.

I made this post with the intent to write a comment, but the process of writing the comment out made it less persuasive to me. The planning fallacy?

7Raemon2yIf this is all that Shortform Feed posts ever do it still seems net positive. :P [edit: conditional on, you know, you endorsing it being less persuasive]
4Raemon2ySimilarly, I sometimes start a shortform post and then realize "you know what, this is actually a long post". And I think that's also shortform doing an important job of lowering the barrier to getting started even if it doesn't directly get used.

Quantitative claims about code maintenance from Working in Public, plausibly relevant to discussion of code rot and machine intelligence:

  • "most computer programmers begin their careers doing software maintenance, and many never do anything but", attributed to Nathan Ensmenger, professor at Indiana University.
  • "most software at Google gets rewritten every few years", attributed to Fergus Henderson of Google.
  • "A 2018 Stripe survey of software developers suggested that developers spend 42% of their time maintaining code" - link
  • "Nathan Ensmenger, the informa
... (read more)
2Viliam3moDoes this definition of "maintenance" include writing new functionality for existing applications? If yes, then I agree; it is a rare opportunity to start coding a non-trivial project from scratch. If no, then I find it difficult to believe how someone could e.g. fix bugs without ever having written their own code first (the school exercises do not count, because in my experience they do not resemble actual industry code).
4DanielFilan3moFrom when the book introduces 'maintenance': So, sounds like the book author isn't including writing new functionality, but IDK if the term has such a fixed and clear meaning that Nathan Ensmenger and all the respondents to the Stripe survey mean the same thing as the book.

Blog post request: a summary of all the UFO stuff and what odds I should put on alien visitations of earth.

'Seminar' announcement: me talking quarter-bakedly about products, co-products, deferring, and transparency. 3 pm PT tomorrow (actually 3:10 because that's how time works at Berkeley).

I was daydreaming during a talk earlier today (my fault, the talk was great), and noticed that one diagram in Dylan Hadfield-Menell's off-switch paper looked like the category-theoretic definition of the product of two objects. Now, in category theory, the 'opposite' of a product is a co-product, which in set theory is the disjoint union. So if the product of two actions is d... (read more)

4DanielFilan2moI do not have many ideas here, so it might mostly be me talking about the category-theoretic definition of products and co-products.

Avoid false dichotomies when reciting the litany of Tarski.

Suppose I were arguing about whether it's morally permissible to eat vegetables. I might stop in the middle and say:

If it is morally permissible to eat vegetables, I desire to believe that it is morally permissible to eat vegetables. If it is morally impermissible to eat vegetables, I desire to believe that it is morally impermissible to eat vegetables. Let me not become attached to beliefs I may not want.

But this ignores the possibility that it's neither morally permissible nor morally impermi... (read more)

6DanielFilan5moAlternate title: negation is a little tricky.

An interesting tension: it's kind of obvious from a micro-econ view that group houses should have Pigouvian taxes on uCOVIDs[*] (where I pay housemates for the chance I get them sick) rather than caps on how many uCOVIDs everyone can incur per week - and of course both of these are better than "just sort of be reasonable" or having no system. But uCOVID caps are nice in that they make it significantly easier to coordinate with other houses - it's much easier to figure out how risky interacting with somebody is when they can just tell you their cap, rather ... (read more)

5Zack_M_Davis2moIt's μCOVID, with a μ!
2DanielFilan2moSorry, I maybe should have cared enough to copy-paste but didn't.
2Ben Pace2mo(Which you get using option-m on a mac.)
6Zack_M_Davis2mo(Or M-x insert-char GREEK SM<tab> L<tab>M<tab> in Emacs.)
2DanielFilan2moEven easier in Helm-mode!

Results from an experiment I just found about inside vs outside view thinking (but haven't read the actual study, just the abstract: beware!)

Contrary to expectation, participants who assigned more importance to inside factors estimated longer completion times, and participants who gave greater weight to outside factors showed higher degrees of confidence in their estimates.

Excerpts from a FB comment I made about the principle of charity. Quote blocks are a person that I'm responding to, not me. Some editing for coherence has been made. tl;dr: it's fine to conclude that people are acting selfishly, and even to think that it's likely that they're acting selfishly on priors regarding the type of situation they're in.

The essence of charitable discourse is assuming that even your opponents have internally coherent and non-selfish reasons for what they do.

If this were true, then one shouldn't engage in charitable discourse. P... (read more)

2Pattern6moWhether it is more charitable to assume someone is or isn't selfish can depend on context.
2Dagon6moI think you (and Wikipedia and Scott) are limiting your ideas of what the principle really means. _IF_ you only care about rationality, it's about assuming rationality. For those of us in conversations where we _ALSO_ care about intent, nuance, and connotation, it can include assuming goodwill and best intentions of your conversational partners. In all cases, the assumption is only a prior - you're getting a lot of evidence in the discussion, and you don't need to cling to a false belief when shown that your opponent and their statements are not correct or useful.