Deffethazrashid

Most people imagine that if we get a benevolent ASI, we'll see a Golden Age slowly appear over 20 or 50 years. I think this is wrong because it ignores the speed difference between biology and physics. If an ASI really figures out how to control matter at the fundamental...

I’ve been iterating on a visualization of a benevolent Hard Takeoff that resolves some of the common anxieties about boredom or "wireheading," while taking the physics of superintelligence seriously. The core intuition is that a truly benevolent ASI, assuming it solves alignment, creates a discontinuity in subjective experience. We tend...