DanielFilan

Comments

Knowledge is not just mutual information

Seems like maybe the solution should perhaps be that you should only take 'the system' to be the 'controllable' physical variables, or those variables that are relevant for 'consequential' behaviour? Hopefully if one can provide good definitions for these, it will provide a foundation for saying what the abstractions should be that let us distinguish between 'high-level' and 'low-level' behaviour.

Survey on AI existential risk scenarios

As a respondent, I remember being unsure whether I should include those catastrophes.

Challenge: know everything that the best go bot knows about go

Ah, understood. I think this is basically covered by talking about what the go bot knows at various points in time, a la this comment - it seems pretty sensible to me to talk about knowledge as a property of the actual computation rather than the algorithm as a whole. But from your response there it seems that you think that this sense isn't really well-defined.

Challenge: know everything that the best go bot knows about go

This is correct, altho I'm specifically interested in the case of go AI because I think it's important to understand neural networks that 'plan', as well as those that merely 'perceive' (the latter being the main focus of most interpretability work, with some notable exceptions).

Challenge: know everything that the best go bot knows about go

OP is a fine way to refer to me, I was just confused since I didn't think my post indicated that my desire was to efficiently program a go bot.

Challenge: know everything that the best go bot knows about go

I guess by 'learner' you mean the human, rather than the learned model? If so, then I guess your transparency/explanation/knowledge-extraction method could be learner-specific, and still succeed at the above challenge.

Curated conversations with brilliant rationalists

FWIW I find it taking more than 1x for native speakers, but I think never longer than 2.5x for anybody.

Challenge: know everything that the best go bot knows about go

I suppose this gets back to OP's desire to program a Go Bot in the most efficient manner possible.

If by "OP" you mean me, that's not really my desire (altho that would be nice).

Load More