Oscar

I read Claude’s Constitution recently. I thought it was very good! This was my favourite quote: > Our own understanding of ethics is limited, and we ourselves often fall short of our own ideals. We don’t want to force Claude’s ethics to fit our own flaws and mistakes, especially as Claude grows in ethical maturity. And where Claude sees further and more truly than we do, we hope it can help us see better, too. Here are some of the other greatest hits according to me (I would encourage you to read the quotes in the endnotes if you haven’t read the full constitution yet – some are quite poetic and touching I thought!). * Including non-humans.[1] * Longtermism/X-risk.[2] * Preventing coups.[3] * AI-augmented moral reflection.[4] * Moral uncertainty and humility.[5] * Striving for the moral truth if it exists.[6] * Creating human flourishing and relieving present day misery.[7] * Claude’s welfare and autonomy.[8] * Claude’s nature and its relationship with Anthropic.[9] * The beginnings of something reasonable on decision theory (FDT-reminiscent?).[10] Mainly, I just want to acknowledge good work when I see it. It is kind of remarkable that one of the most important companies in the world has values so similar to mine in many ways.[11] But I wonder if there are any other strategic implications: * Making Anthropic more likely to ‘win’ seems a bit better to me than it used to. * This seems like a great standard to try to hold other companies to. I imagine I would like the constitutions of other companies far less, given my moral views are so similar to those of Askell et al. But if alignment ends up being somewhat easy, making the leading companies’ constitutions better seems high leverage. * A non-existential global catastrophe that sets us back a long way (e.g. a nuclear winter) seems a bit worse than it used to from a longtermist perspective, since (hot take?) it feels like we are lucky with how thoughtful a/the AI leader is compared to a reroll of h