mesaoptimizer

I've been thinking about memetically fit Schelling points in the AGI policy space. I'll describe four such "Schelling policies", and use them as pedagogical examples. Shut it all down MIRI's new stated objective is the clearest example of a Schelling policy: "Shut it all down". MIRI states that they want...

I stumbled upon a Twitter thread where Eliezer describes what seems to be his cognitive algorithm that is equivalent to Tune Your Cognitive Strategies, and have decided to archive / repost it here. > Sarah Constantin: I really liked this example of an introspective process, in this case about the...

This is an informal post intended to describe a workflow / setup that I found very useful, so that others might consider adopting or experimenting with facets of it that they find useful. In August 2023, I was a part of MATS 4.0 and had begun learning the skill of...

Because the original webpage (and domain) is down, and it takes about a minute (including loading time) for Wayback Machine to give me the page, I've decided to repost this essay here. I consider it an essay that seems core to 2010s rationalist discourse. The Copenhagen Interpretation of quantum mechanics...

Here is a repository of EPUBs that I've created, consisting of rationalist or alignment content I want to read on my Kindle, such as selections of the MIRI (Blog) Archives and of multiple LessWrong Sequences that I am reading or intend to read. This post is an announcement that this...

2024-01-11 update: Sourcehut, the host I used for this repository, is down. I think I'll move to another setup to host these books. I've created an EPUB of the AI Alignment section of Arbital so I can read Arbital essays on my Kindle. Download the EPUB here. Details for how...

Epistemic status: I'm pretty confident about this; looking for feedback and red-teaming. As of 2023-06-30, I notice multiple epistemological errors in this document. I do not endorse the reasoning in it, and while my object-level claims haven't changed radically, I am in the process of improving them using better epistemological...