LESSWRONG
LW

515
orthonormal
17973Ω28870282734
Message
Dialogue
Subscribe

Sequences

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
Staying Sane While Taking Ideas Seriously
9orthonormal's Shortform
Ω
6y
Ω
41
Please Do Not Sell B30A Chips to China
orthonormal4d40

Arms races are bad things. First best by far is if nobody has the doomsday devices, but second best is if we attempt nonproliferation of doomsday devices.

As a parallel, we would have been still at risk in a world where DeepMind was working on building ASI but where Elon didn't freak out and start a competitor (followed by another competitor), but not as much risk. That's not because DeepMind are "the good guys", it's because of race dynamics.

Reply
Asking (Some Of) The Right Questions
orthonormal11d2-1

Capabilities being more jagged reduces p(doom), less jagged increases it.

Ceteris paribus, perhaps, but I think the more important factor is that more jagged capabilities imply a faster timeline. In order to be an existential threat, an AI only needs to have one superhuman ability that suffices for victory (be that superpersuasion or hacking or certain kinds of engineering etc), rather than needing to exceed human capabilities across the board.

Reply
On Fleshling Safety: A Debate by Klurl and Trapaucius.
orthonormal11d42

rot13: Gur snvyfnsr jnf gur bayl cneg gung fhecevfrq zr, naq gur qvrtrgvp rkcynangvba sbe ubj guvf frghc pbhyq unir unccrarq ng nyy jnf phgr.

Reply
Monthly Roundup #34: September 2025
orthonormal2mo20

I may never stop finding it funny the extent to which Trump will seek out the one thing we know definitively is going badly, then and choose that to lie and brag about.

We're not the target audience for those posts. He's telling everyone who's kissing his ass that this is a topic he wants them to lie about as well.

Reply
Monthly Roundup #33: August 2025
orthonormal2mo42

If we were doing a better job catching cheaters presumably people would be doing it less?

Seems trivially easy for an idiot to start an account, lose some games, get frustrated, and start asking a chess bot what to do so that they can rescue a bad position / show that bastard what's what / vicariously enjoy winning. I expect that crowd to be the majority of cheaters, and for them to be essentially inelastic to the probability with which they get caught (the first time).

Reply
My Interview With Cade Metz on His Reporting About Lighthaven
orthonormal3mo3115

I believe that Cade knows perfectly well what everyone has been saying for years; he's being disingenuous because the object level doesn't matter to him, and the only important thing is ensuring that these weirdos don't get status. He's never once engaged on simulacrum level 1 with this community.

Reply
Comp Sci in 2027 (Short story by Eliezer Yudkowsky)
orthonormal3mo60

At long last, Elon Musk has created the Yandere Simulator from the classic short story Don't Create The Yandere Simulator, Among Other Things

Reply
Elizabeth's Shortform
orthonormal3mo42

On several of these I think you might be confounding the positively correlated variables "has heard of this question" and "is on the autism spectrum", the latter of which is anticorrelated with the kind of behavior you want (intuitive, empathetic listening without needing to ask a bunch of explicit questions). I find it unlikely that asking the question makes people worse at the behavior you want.

Reply
Fighting Obvious Nonsense About AI Diffusion
orthonormal6mo140

Zvi is arguing "X implies Y" here. Zvi happens to believe Y but disbelieve X; however, he is writing to people who think "X and not-Y", in order to nudge them to support Y.

Here X = it is good for the US to build superintelligence fast, before China does, and Y = we should have some diffusion rules making it harder for China to catch up to the USA. 

Zvi believes Z = nobody should be building superintelligence soon, and believes Z implies Y, but it is useful to show that X implies Y as well.

Reply
orthonormal's Shortform
orthonormal6moΩ120

Question for @Scott Garrabrant, @TsviBT, @Andrew_Critch, @So8res, @jessicata, and anyone else who knows the answer: the logical inductor constructed in the paper is not merely computable but also primitive recursive, right? 

Seems obvious to me (because the fixed price point is approximated, etc), but I want to be sure I'm not missing something.

Reply
Load More
202How I Learned To Stop Trusting Prediction Markets and Love the Arbitrage
1y
30
49Run evals on base models too!
Ω
2y
Ω
6
36Mesa-Optimizers via Grokking
Ω
3y
Ω
4
39Transitive Tolerance Means Intolerance
4y
13
16Improvement for pundit prediction comparisons
5y
4
140Developmental Stages of GPTs
Ω
5y
Ω
72
62Don't Make Your Problems Hide
5y
5
30Map Errors: The Good, The Bad, and The Territory
5y
4
28Negotiating With Yourself
5y
0
46[Link] COVID-19 causing deadly blood clots in younger people
6y
10
Load More
Qualia
5 years ago
(+466)
Modal combat
9 years ago
(+281/-7)
Mathematical induction
9 years ago
(+421)
Modal logic
9 years ago
(+6)
Löb's theorem
9 years ago
(+38)
Löb's theorem
9 years ago
Peano Arithmetic
10 years ago
(+809)