This is a special post for quick takes by yancsi. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
It seems we already have artificial superintelligence (if the recent math drops have not convinced you, I don't know what will) and the world still.. functions normally?
I am concerned about alignment, but this makes me update significantly towards it being possible?
I'd argue that it's AGI in the weak sense of being at least comparably good in almost all cognitive tasks than some nontrivial subset of humans. It's also better than every human in some important narrower tasks (though that was also true last decade), but not full ASI even in a weak sense because it's still worse than a lot of humans in some ways that are important for the world to change by a lot.
However, I expect that the world will not continue to function normally, even if there is zero progress in AI capabil... (read more)
It's a narrow superintelligence. In some way just a very advanced calculator solving all math. I think once we reach genuine human level AGI we are well deep into the singularity however, and we don't seem to be far off