Introduction Tom Davidson and Tom Houlden’s prior model of an intelligence explosion poses the question: after AIs can entirely substitute for human researchers at the task of improving AI, how many year-equivalents of AI progress might be packed into a short period of time solely from further software progress, holding...
Suppose an AI company is considering whether to include some particular quality X – a rule, virtue, heuristic, default, attitude, goal, or style – in a model spec. Perhaps they are considering whether their LLM should have prosocial drives. Perhaps they’re wondering if the LLM should whistleblow to help prevent...
Current model specs aim to shape the behaviors of near-present models, rather than the behaviors of models arbitrarily far into the future. OpenAI writes that their model spec aims to apply “0-3 months ahead of the present.” Anthropic’s Constitution for Claude notes that the document “is likely to change in...
Like many of us, I find both (1) an unusual amount of time on my hands to read and (2) a renewed interest in systems of governance which lead to competent collective decision-making. I honestly haven't read much in this sphere. I was hoping for something which is to, say,...
Epistemic Status: Everyone already knows about it? I've been thinking a bit about two different manners of pursuing a goal. I haven't come up with a catchy jargon for them, and I don't know of any existing catchy jargon for them either. General v. specific planning is pretty bad, but...
I'm trying to come up with a set of questions for self-calibration, related to AI and ML. I've written down what I've come up with so far below. But I am principally interested in what other people come up with -- thus the question metatype -- both for questions, and...