kaputmi

Does it matter if AI destroys the world? Lots of (virtual) ink has been spilled on AGI x-risk. The median opinion on this forum is that when AGI is birthed, it will have terminal values that are unaligned humanity’s; it will therefore pursue those terminal values at the expense of...

Overconfidence is easy to maintain if, and only if, it goes untested. This is the great trap found in many “soft sciences.” If feedback loops are short enough, with high enough fidelity, authority is of no great independent significance because it is derived from accuracy and its validity is updated...