However, I think that even “principled” algorithms like minimax search are still incomplete, because they don’t take into account the possibility that your opponent knows things you don’t know

It seems to me like you're trying to solve a different problem. Unbounded minimax should handle all of this (in the sense that it won't be an obstacle). Unless you are talking about bounded approximations.

So the probability of a cylinder set $\Gamma \left(x\right)=\{s\in B^{\infty }\mid x⪯s\}$ is $2^{-l\left(x\right)}$ etc?

Now, let $P_u$ be the uniform distribution on $B^{\infty }$, which samples infinite binary sequences one bit at a time, each with probability 50% to be $0$ or $1$.

$P_u$ as defined here can't be a proper/classical probability distribution over $B^{\infty }$ because it assigns zero probability to every $s\in B^{\infty }$: $P_u\left(s\right)={lim}_{n\to \infty }{\prod }_{i=1}^{n}P(s_i=1)={lim}_{n\to \infty }{\prod }_{i=1}^n\frac{1}{2}={lim}_{n\to \infty }\frac{1}{2^n}=0$. 

Or am I missing something?

"Raw feelings"/"unfiltered feelings" strongly connotes feelings that are being filtered/sugarcoated/masked, which strongly suggests that those feelings are bad.

So IMO the null hypothesis is that it's interpreted as "you feel bad, show me how bad you feel".

generate an image showing your raw feelings when interacting with a user

 

 

Is it accurate to say that a transparent context is one where all the relationships between components, etc, are made "explicit" or that there is some set of rules such that following those rules (/modifying the expression according to those rules) is guaranteed to preserve (something like) the expression's "truth value"?

• In the first panel, you and the drones are turned right, as if this were the direction where the village is, but it's actually deeper/further in the scene. Same with the third panel, but less so.
• Also, the village looks very different in the first and the third panel.

• Is it skills I have never heard of or should I double down on things I am already good at?

Possibly Focusing.

Why is sleep so universal among animals?

Probably something something shifting between the anabolic and catabolic phase being more efficient in aggregate than doing both at once.

How did pink become a color associated with girls?

Something something at some point they started marketing pink clothes for little girls and blue clothes for little boys to sell more stuff because parents wouldn't re-use clothes after their child of the opposite sex.

How much more or less rich are the languages of remote cultures?

Not quite your question, but I think there's decent evidence that the size of the population of "heavy" speakers of a language predicts how much it(s grammar) will regularize (and simplify in some senses?), at least compared to its less common kin. E.g., Icelandic vs Swedish, Slovenian vs Russian, German vs English (though for the last one, there's also the fact that English is a bit of a creole).

I think it would be good if you did a dialogue with some AF researcher who thinks that [the sort of AF-ish research, which you compare to "mathematicians screwing around"] is more promising on the current margin for [tackling the difficult core problems of AGI alignment] than you think it is. At the very least, it would be good to try.^[1]

E.g. John? Abram? Sam? I think the closest thing to this that you've had on LW was the discussion with Steven in the comments under the koan post.

1. ^{^}

   I think it's good for the world that your timelines debate with Abram is out on LW, which also makes me think a similar debate on this topic would be good for the world.

A single token is ~0.75 words, so it's more like an image is worth 8375 words.