Jordan Arel

9 reasons against a near-term AI slow-down

I’ve heard more arguments in favor of a near-term[1] coordinated AI pause/slow-down[2] than arguments against. I think such questions, including complex flow-through effects, are difficult, and it’s important to really consider both sides. I am not convinced by these arguments, and feel highly uncertain as to when a slow-down would...

Sep 284

Questions for the “New Enlightenment” in the Age of AGI

Cross-posted from Substack. In a Lockean state of mind. Epistemic status: This post started out this morning as a shower-thoughts style shortlist, and then got slightly more substantial. I would still consider it highly incomplete, and mostly a jumping off point for further work. Additional suggestions and criticisms appreciated! Inspired...

Sep 118

(Question) When should I cross-post on LessWrong vs. EA Forum only?

I noticed the “questions” feature is gone so just posting this as a post, hope that’s OK. While I feel like I have a good idea when to post something on the EA Forum (effective impact focused), I feel less clear when I should post on LessWrong. In particular, I...

Sep 114

Launching: The "Human-AI Symbiosis Movement" (HAISM)

By now we've all heard of the "AI psychosis" phenomenon, A.K.A. "Parasitic AI." As of today, April 1st, I have decided it is time to release this gem of a memo from the underground vaults of my Google Docs, in order to officially soft-launch the foil and cure to this...

Apr 16

If we get primary cruxes right, secondary cruxes will be solved automatically

Cruxes Decide Future Value I recently came to an important macrostrategy realization. A “crux” or “crucial consideration” (used interchangeably) is some factor which determines a significant portion of how valuable our future is. A classic example is the importance of preventing human extinction, which could clearly be one of the...

Jan 141

If researchers shared their #1 idea daily, we'd navigate existential challenges far more effectively

What's a crux? A “crux” for short, or “crucial consideration” for long, is an idea that, if understood and acted upon, could significantly shift humanity's trajectory toward better outcomes. These are the golden nuggets that x-risk researchers care about most: insights that bring us closer to averting catastrophes and achieving...

Jan 145

In defense of the goodness of ideas

Epistemic status: This was an original note in its raw, unedited form. I can't finish it now, as I am writing a post for the fast-approaching "Essays on Longtermism" competition. It came out not-too-shabby, so I don't feel too bad about it. But I really wish I had time to...

Oct 18, 20256

Jordan Arel

Jordan Arel

To what extent is AI safety work trying to get AI to reliably and safely do what the user asks vs. do what is best in some ultimate sense?

“Momentism”: Ethics for Boltzmann Brains

Does “Momentism” via Eternal Inflation dominate Longtermism in expectation?

Questions for the “New Enlightenment” in the Age of AGI

Jordan Arel

To what extent is AI safety work trying to get AI to reliably and safely do what the user asks vs. do what is best in some ultimate sense?

“Momentism”: Ethics for Boltzmann Brains

Does “Momentism” via Eternal Inflation dominate Longtermism in expectation?

Questions for the “New Enlightenment” in the Age of AGI

9 reasons against a near-term AI slow-down

Questions for the “New Enlightenment” in the Age of AGI

(Question) When should I cross-post on LessWrong vs. EA Forum only?

Launching: The "Human-AI Symbiosis Movement" (HAISM)

If we get primary cruxes right, secondary cruxes will be solved automatically

If researchers shared their #1 idea daily, we'd navigate existential challenges far more effectively

In defense of the goodness of ideas