The progress and success of AI research in the past decade seem all point back to some very basic principles about the nature of intelligence discovered last century. These include 1) Feedback mechanism by Robert Wiener, 2) Information theory by Claude Shannon, 3) Universal computation by Alan Turing:
1) Feedback in a very general sense is an abstraction of information close-loop to ensure continual improvement/adaptation of an intelligent sub-system.
Humans and animals need feedback to improve skill-level of doing something. A product/technique needs real-world feedback signal to iteratively improve to be usable. Any useful autonomous system is closed-loop feedback system. From this perspective, it is unsurprising that open-loop self-supervised/imitation learning alone does not produce... (read 979 more words →)