This is a special post for quick takes by Kabir Kumar. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
btw, yud failure mode and something i see in a lot of rats:
Lacking humility and lacking the propensity to take time to understand and appreciate that which isnt immediately obviously valuable - especially things that take reworking ones interpretation and realising that ones first interpretation was wrong.
It's a humility + path dependant interpretation failure
solution: when having a feeling of dismissal and high confidence on something from little data, noticing that and training this sense - and also training the sense of noticing when a strong feeling/interpretation is downstream of just one particular viewpoint - similarly to noticing when one either loves/hates a person/thing just because of one person telling them lots and lots of good/bad things about it.
But instead of the source being just one person, its one or two types of interpretation.
I wonder on which sense Yudkowsky's first interpretation was bad. When his long list of reasons for AGI to be deadly was reevaluated in 2026, the most load-bearing crux from the point 25 stayed unsolved and Yudkowsky's other disproven ideas didn't seem enough to super-reliably avert the disaster.