leogao's Shortform

leogao

This is a special post for quick takes by leogao. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.

have you ever heard anyone make the argument that it's good to have AI safety aligned frontier labs (including but not limited to Anthropic) because they will have a seat at the table with the regulators, and the regulators will take major industry players' opinions more seriously than minor players or activists?

i've heard this argument but i'm trying to figure out if it's common enough to be worth writing a post about

In my opinion, this position was sensible when the labs themselves were branded as MIRI-like but with added emphasis on technical experimentation. The second it became clear that these 'labs' principal reward function was not their claimed preferences (for alignment research - which OAI was explicitly communicating under the moniker of safety), our personal semantic landscapes were already trained enough by the narrative, that we missed the major conflict of interest here before establishing the norm.

They will continue to use epistemic asymmetry and levera... (read more)

2Amalthea7mo

I think it's a good argument, but Anthropic doesn't seem quite aligned enough to make it work. E.g. they don't seem to have been pushing for a coordinated Pause to any real extent (and if they don't think this would be a good idea, haven't clarified their position as far as I know).

7anaguma7mo

I've heard this before.

leogao's Shortform

8

Ω 4

leogao's Shortform

8

Ω 4