LESSWRONG
LW

Jayjay

Message

[Rough notes, BAIS] Human values and cyclical preferences

epistemic status: Working notes of three different people on the same question, likely useless/incomprehensible to anyone else The question How to find the right abstraction level of human values Problems in over- or underfitting human values: We can learn human values by observing their actions and distilling them into a...

May 13, 2022•5

Jayjay

Jayjay — LessWrong

Jayjay

Message

[Rough notes, BAIS] Human values and cyclical preferences

May 13, 2022•5

Jayjay

Replying toInvesting for a World Transformed by AI

Jayjay3y

Investing for a World Transformed by AI

Independent of effects on GDP, the internet (nasdaq100) has still strongly outperformed the overall US stock market (sp500).

[Rough notes, BAIS] Human values and cyclical preferences

pranomostro

pranomostro, Jayjay, Lucie Philippon+ 0 more

pranomostro, Jayjay, Lucie Philippon

epistemic status: Working notes of three different people on the same question, likely useless/incomprehensible to anyone else

The question

How to find the right abstraction level of human values

Problems in over- or underfitting human values:

We can learn human values by observing their actions and distilling them into a preference relation. This learned preference relation can overfit human values (eg: Humans want to raise their left arm by 2 cm on 2022-05-07 if they’re in some specific place) or it can underfit human values (eg: Humans care only about maximizing money). If our preference relation overfits, we expect to not find some known biases, e.g. the Allais Paradox. There are also both inconsistencies that are... (read 1054 more words →)