LESSWRONG
LW

Roman Malov
1879510
Message
Dialogue
Subscribe

Bachelor in general and applied physics. AI safety/Agent foundations researcher wannabe. 

I love talking to people, and if you are an alignment researcher we will have at least one common topic (but I am very interested in talking about unknown to me topics too!), so I encourage you to book a call with me: https://calendly.com/roman-malov27/new-meeting

Email: roman.malov27@gmail.com
GitHub: https://github.com/RomanMalov
TG channels (in Russian): https://t.me/healwithcomedy, https://t.me/ai_safety_digest

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
No wikitag contributions to display.
Roman Malov's Shortform
Roman Malov9d33

People often say, "Oh, look at this pathetic mistake AI made; it will never be able to do X, Y, or Z." But they would never say to a child who made a similar mistake that they will never amount to doing X, Y, or Z, even though the theoretical limits on humans are much lower than for AI.

Reply
Roman Malov's Shortform
Roman Malov10d20

Idea status: butterfly idea

In real life, there are too many variables to optimize each one. But if a variable is brought to your attention, it is probably important enough to consider optimizing it.

Negative example: you don’t see your eyelids; they are doing their job of protecting your eyes, so there’s no need to optimize them.

Positive example: you tie your shoelaces; they are the focus of your attention. Can this process be optimized? Can you learn to tie shoelaces faster, or learn a more reliable knot?

Humans already do something like this, but mostly consider optimizing a variable when it annoys them. I suggest widening the consideration space because the “annoyance” threshold is mostly emotional and therefore probably optimized for a world with far fewer variables and much smaller room for improvement (though I only know evolutionary psychology at a very surface level and might be wrong).

Reply
The Observer Effect for belief measurement
Roman Malov1mo20

To the first: I already addressed it in the "Why not just...?" part:

Add "hey I'm just probing you, please don't update on that query" in the query 


That might decrease the update a bit, but insofar if inquirer counterfactually adds that in cases they need the answer in some hypothesis-specific case the oracle would still update somewhat.

To the second: that one might actually work, I don't see an obvious way it fails. Perhaps only in the scenario with an extremely smart oracle, which could somehow predict the question you actually want to know the answer to. But at that point it would be hard to stop it from updating on anything, so updating on the query would be the least of your problems. Though it only gives you an answer to 1 question traded for 1000 queries. If we want full distribution, that would require 1000*#of_hypotheses queries, which is O(n) and beats my O(n!) suggestion, but it is still far from ~1 query per hypothesis (which would be ideal).

Reply
Doomsday Argument and the False Dilemma of Anthropic Reasoning
Roman Malov1mo10

P(First|Second)

I think you meant P(Second|Find) here.

Reply
LessWrong Feed [new, now in beta]
Roman Malov1mo10
Reply
Daniel Kokotajlo's Shortform
Roman Malov2mo10

I am a bit confused about what 10x slowdown means. I assumed you meant going from eλt to e0.1λt on R&D coefficient, but the definition from the comment by @ryan_greenblatt seems to imply going from eλt to 0.1eλt (which, according to AI 2027 predictions, would result in a 6-month delay).

The definition I'm talking about:

8x slowdown in the rate of research progress around superhuman AI researcher level averaged over some period

Reply
LessWrong Feed [new, now in beta]
Roman Malov2mo30

i.e. to see fresh comments

Reply1
Against Infrabayesianism
Roman Malov2mo10

Where specifically that assumption is spelled out?

Reply
LessWrong Feed [new, now in beta]
Roman Malov2mo10

Also, I don't like that if I click on the post in the update feed and then refresh the page I loose the post

Reply
LessWrong Feed [new, now in beta]
Roman Malov2mo10

It might be that I have smth wrong with the internet but this beige widget isn't loading

Reply
Load More
3Roman Malov's Shortform
9mo
30
9Two Types of (Human) Uncertainty
23d
2
8The Observer Effect for belief measurement
1mo
4
12An Analogy for Interpretability
2mo
2
5Question to LW devs: does LessWrong tries to be facebooky?
3mo
1
12Could we go another route with computers?
Q
3mo
Q
4
5Neuron Activations to CLIP Embeddings: Geometry of Linear Combinations in Latent Space
7mo
0
9Is "hidden complexity of wishes problem" solved?
Q
8mo
Q
4
3Roman Malov's Shortform
9mo
30
25Visual demonstration of Optimizer's curse
9mo
3