Top postsTop post
I've seen lots of arguments here conflate lots of different types of superintelligence. Here I separate out two broad categories, which I'll term minimal and maximal superintelligences. This is an important distinction as they differ in terms of timelines, risks, and mitigations. Maximal superintelligence This is the idealised limit of...
One of the most frequently suggested ways AI could wipe out humanity is via an engineered virus. I have no doubt that a sufficiently intelligent AI given sufficient time could socially-or-otherwise engineer his way to have a whole team of people working on developing super-viruses to wipe out humanity, and...
I don't think this is particularly impressive, or interesting for anyone else, but I think it may turn out to be useful in the future to have an easily visible public record of what happened, so here goes: I am an L5 SWE at Google Israel. I have been there...
With the recent highly publicised alignment failures from OpenAI and Anthropic there's been increasing calls for an AI pause, to allow alignment to catch up. However a pause has various obvious issues: * It's possible that we can't make further alignment progress without more advanced AIs: * Trying to align...
Israel recently inaugurated it's billion shekel reverse water carrier project[1], pumping desalinated water into the Sea of Galilee, Israel's largest freshwater lake[2]. It's being billed as an ecological move, aiming to restore the drying lake and saving the human and natural ecosystems that thrive on the lakes shores. As such,...
Imagine in 6 months or 6 years, a frontier AI model goes horribly wrong. Perhaps it releases a synthetic virus which kills hundreds. Perhaps it shuts down the internet. Perhaps it gains control over China's nuclear armament. Fortunately humanity survives without too much lasting damage. But in the immediate aftermath...
Before I start, I'll mention that I'm in contact with a world expert on legislation and regulation, who would be happy to help with this or similar work pro-bono. If you work in AI policy and believe this could help you, please reach out. OpenAI recently announced that one of...