Daniel_Eth

Tl;dr: We believe shareholders in frontier labs who plan to donate some portion of their equity to reduce AI risk should consider liquidating and donating a majority of that equity now. Epistemic status: We’re somewhat confident in the main conclusions of this piece. We’re more confident in many of the...

TL;DR – Individuals with technical backgrounds are well-positioned to advance AI safety policy in numerous ways. Opportunities include both A) technical research directions, including evals, compute governance mechanisms, infosec, and forecasting, and B) career paths for advancing AI policy, including policymaking and communication efforts. Contrary to what many people assume,...

Empirical evidence suggests that, if AI automates AI research, feedback loops could overcome diminishing returns, significantly accelerating AI progress. Summary AI companies are increasingly using AI systems to accelerate AI research and development. These systems assist with tasks like writing code, analyzing research papers, and generating training data. While current...

The Long-Term Future Fund (LTFF) makes small, targeted grants with the aim of improving the long-term trajectory of humanity. We are currently fundraising to cover our grantmaking budget for the next 6 months. We would like to give donors more insight into how we prioritize different projects, so they have...

On Tuesday, the US Senate Judiciary Subcommittee on Privacy, Technology and the Law held a hearing on AI. The hearing involved 3 witnesses – Dario Amodei (CEO of Anthropic), Yoshua Bengio (Turing Award winner, and the second-most cited AI researcher in the world), and Stuart Russell (Professor of CS at...

The following was my submission to the AI Alignment Awards Shutdown Contest, for which it won an honorary mention prize: My proposal is as follows: 1) pre-train a model for broad capabilities (though not to AGI) 2) create a list of different sub-characteristics that in aggregate yield incorrigibility, but where...

I've written a blog post for a lay audience, explaining some of the reasons that AI researchers who are concerned about extinction risk have for continuing to work on AI research, despite their worries The apparent contradiction is causing a a lot of confusion among people who haven't followed the...