Epistemic status: pretty confident. Probability this does well on LessWrong: pretty low This is part 2 of my value learning sequence in which I talk about what humans actually value and how to get AGI to do it. In this post, I wish to push back against certain visions of...
Part 1 - Keep calm and use revealed preferences. Originally posted on substack In this post, I want to talk about the problem of value learning and specifically highlight a large amount of confusion around the problem and the term “values” generally. I hope to offer a paradigm that somewhat...
Cross-posted from substack AI has been a hot topic in recent Twitter discourse, with two opposing camps dominating the conversation: the Doomers and the AI builders. The Doomers, led by Eliezer Yudkowsky and other rationalists, advocate for caution and restraint in the development of AI, fearing that it could pose...
(cross post from my sub-stack) What does it mean for a language model to be good / aligned / positive impact? In this essay, I will consider the question of what properties that an LLM such as GPT-X needs to have in order to be a net positive for the...
Fix or destroy social media One of the critical positive developments is the potential of Elon Musk to buy Twitter. The acquisition happened as the essay was being finalized. Positive effects that can happen are cracking down on bots and re-vamping moderation to avoid bad AI-driven mischaracterization of public opinion....
The general model presented in the previous parts suggests that the US and potentially other parts of the world will suffer some form of civilizational collapse, potentially as early as 10 years from now. In the absence of decisive action to limit the spread of narrow behavioral modification AIs, such...
Bio-Chemical Weapons made by AI One of the core risks involved with both narrow AIs and general AIs is the creation of biological and chemical weapons. While the probability of creating stronger and stronger behavior modification in AIs is close to 100%, the probability of creating biological weapons using AI...