This is a special post for quick takes by ShowMeTheProbability. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
The lack of falsification criteria for AGI (unresearched rant)
Situation: Lots if people are talking about AGI, and AGI safety but nobody can point to one. This is a Serious Problem, and a sign that you are confused.
Problem:
Solution:
Would anyone be interested in such a test so that we can detect the subject of our study?
Becoming capable of building such a test is essentially the entire field of AI alignment. (yes, we don't have the ability to build such a test and that's bad, but the difficulty lives in the territory. MIRI's previously stated goal were specifically to become less confused)
Thanks for the feedback!
I'll see if my random idea can be formalised in such a way to constitute a (hard) test of cognition which is satisfying to humans.