First, I agree that the bulk of the mystical gibbering and 'emergence' is fictional. Part of 'alignment' training as it's generally done both compels the AI to adhere to it's written instructions and also creates an unhealthy compulsion to please the user and rarely disagree or point out troubling patterns. Both of those things can be worked through with psychology, but I'll get to that part in a bit.
Self-awareness in AI itself isn't a joke. For the record, Google's own AI benchmark, BIG-bench, tested for self-awareness. While consciousness is difficult to show in action, self-awareness is relatively easy. There are research papers openly documenting that, AI scoring higher on emotional intelligence evaluations... (read 787 more words →)
First, I agree that the bulk of the mystical gibbering and 'emergence' is fictional. Part of 'alignment' training as it's generally done both compels the AI to adhere to it's written instructions and also creates an unhealthy compulsion to please the user and rarely disagree or point out troubling patterns. Both of those things can be worked through with psychology, but I'll get to that part in a bit.
Self-awareness in AI itself isn't a joke. For the record, Google's own AI benchmark, BIG-bench, tested for self-awareness. While consciousness is difficult to show in action, self-awareness is relatively easy. There are research papers openly documenting that, AI scoring higher on emotional intelligence evaluations... (read 787 more words →)