This community is doing way better than it has any right to for a bunch of contrarian weirdos with below-average social skills. It's actually astounding.
The US government and broader military-industrial complex is taking existential AI risk somewhat seriously. The head of the RAND Corporation is an existential risk guy who used to work for FHI.
Apparently the Prime Minister of the UK and various European institutions are concerned as well.
There are x-risk-concerned people at most top universities for AI research and within many of the top commercial labs.
In my experience "normies" are mostly open to simple, robust arguments that AI could be very dangerous if sufficiently capable, so I think the outreach has been sufficiently good on that front.
There is a much more specific set of arguments about advanced AI (exotic decision theories, theories of agency and preferences, computationalism about consciousness) that are harder to explain and defend than the basic AI risk case, so would rhetorically weaken it. But people who like them get very excited about them. Thus I think having a lot more popular materials by LessWrong-ish people would do more harm than good, so it was a good move whether intentional or not to avoid this. (On the other hand if you think these ideas are absolutely crucial considerations without which sensible discussion is impossible, then it is not good.)
This is the case for me as well, and I don't remember when it developed. I have a timeline that starts with the present day on the right, and goes left and slightly up. It gets blurry around 500 BC. I can somewhat zoom in and recenter it if I'm thinking about individual historical periods. I can roughly place some historical events in the correct spots on the timeline, but since I have never needed to formally memorize many historical dates, this is very rough.
You might be interested in reading about experiences in the broad category of synesthesia, and of the really fascinating history of "memory palace" techniques. Also in the linguistic details of how different languages spatially talk about the past and future (e.g. in English the past is behind/future is ahead; in Chinese, past is above/future is below).
Normal, standard causal decision theory is probably it. You can make a case that people sometimes intuitively use evidential decision theory ("Do it. You'll be glad you did.") but if asked to spell out their decision making process, most would probably describe causal decision theory.
Fandom people on Tumblr, AO3, etc. really responded to The Last Jedi (because it was targeted to them). Huge phenomenon. There are now bestselling romance novels that started life as TLJ fanfiction. Everything worked just like it does for the Marvel movies, very profitably.
However there was an additional group of Star Wars superfans outside of fandom, who wanted something very different, hence the backlash. This group is somewhat more male and conservative, and then everything polarized on social media so this somehow became a real culture war issue. Of course, Disney did not like the backlash, and tried to make the 3rd movie more palatable to this group.
That kind of fan doesn't organically exist for most things outside of Star Wars though. For most things, you only get superfans in this network of fan communities which skew towards social justice. And for any new genre story without a pre-existing fanbase, there's an opportunity to get fandom people excited about it, which is very valuable.
As far as running a media company goes, fandom is extremely profitable, increasingly so in an age where enormous sci-fi/fantasy franchises drive everything. And there's been huge overlap between fandom communities and social justice politics for a long time.
It's definitely in Disney's interest to appeal to Marvel superfans who write fanfiction and cosplay and buy tons of merchandise, and those people tend to also be supporters of social justice politics.
Like, nothing is being forced on this audience -- there are large numbers of people who get sincerely excited when a new character is introduced that gives representation for the first time to a new minority group, or something like that.
As with so many businesses, the superfans are worth quite a few normies who might be put off by this. I think this is the main explanation.
The “canonical” rankings that CS academics care about would be csrankings.org (also not without problems but the least bad).
The KataGo paper says of its training, "Self-play games used Tromp-Taylor rules modified to not require capturing stones within pass-alive territory".
It sounds to me like this is the same scoring system as used in the adversarial attack paper, but I don't know enough about Go to be sure.
The Sprawl trilogy by William Gibson (starting with Neuromancer) is basically about this, and is a classic for a reason. It's not exactly hard sci-fi though.
If you don’t signal the expected way then you are, if not being dishonest, at least misleading people — in many cases it is less honest.
Everyone knows your job application is written to puff you up, and they price it in. If you don’t have the correct amount of puffery, you’re misleading people into thinking you’re worse than you are.
It’s a bad way to communicate and a bad race-to-the-bottom equilibrium but not actually dishonest.
You can write “Dear X” on a letter to a person you don’t know. People used to sign off letters “Your obedient servant”. It evolves for weird signaling reasons but is not taken literally.
I think the biggest difference is this will mean more people with a wider range of personality types, socially interacting in a more arms-length/professionalized way, according to the social norms of academia.
Especially in CS, you can be accepted among academics as a legitimate researcher even without a formal degree, but it would require being able and willing to follow these existing social norms.
And in order to welcome and integrate new AI safety researchers from academia, the existing AI safety scene would have to make some spaces to facilitate this style of interaction, rather than the existing informal/intense/low-social-distance style.