TL;DR I spent a few hours going through Open Philanthropy (OP)'s grant database. The main findings were: * Open Philanthropy has made $28 million grants for Technical AI Safety (TAIS) in 2024 * 68% of these are focused on evaluations / benchmarking. The rest is split between interpretability, robustness, value...
This is a linkpost to a recent blogpost from Michael Nielsen, who has previously written on EA among many other topics. This blogpost is adapted from a talk Nielsen gave to an audience working on AI before a screening of Oppenheimer. I think the full post is worth a read,...
I spent a few hours going through Open Philanthropy (OP)'s grant database. The main findings were:
My overall takeaway was that very few TAIS grants are directly focused on making sure systems are aligned / controllable / built safely.[1]
I:
TL;DR
From a skim, there are many claims here which I agree / sympathise with.
That said, I also want to make sure this piece stands up to the epistemic "sniff" test. The gist of the piece seems to operate around Simulacrum Levels 2 / 3 ["Choose what to say based on what your statement will cause other people to do or believe" / "Say things that signal membership to your ingroup."].[1]
From a quick epistemic spot check of just the intro, I'd say that half the claims are accurate on SL1. My guess is this is pretty standard for a lot of advocacy-focused writing, but lower than most LW writing.
--
Below is a short epistemic... (read 666 more words →)
I think this is similar to the governance arrangement in Northern Ireland that ended the troubles (for the most part). Both sides need to share power in order to govern. If one side is perceived to go too far then the other can resign from government, effectively vetoing the other.
This is a linkpost to a recent blogpost from Michael Nielsen, who has previously written on EA among many other topics. This blogpost is adapted from a talk Nielsen gave to an audience working on AI before a screening of Oppenheimer. I think the full post is worth a read, but I've pulled out some quotes I find especially interesting (bolding my own)
... (read 570 more words →)I was at a party recently, and happened to meet a senior person at a well-known AI startup in the Bay Area. They volunteered that they thought "humanity had about a 50% chance of extinction" caused by artificial intelligence. I asked why they were working at an AI startup if
Also, for those eligible to work in the UK, consider applying to work in the taskforce here (Deadline tomorrow!)
I stumbled upon this post <3 years later and - wow, seems like we're very close to some fire alarms!
Expert Opinion
Would Hinton and Bengio tick this box?
I'm don't think we're quite at the point where no major news organization willing to deny AI... (read 657 more words →)