[This is mostly posted as a some thoughts I wanted to check. I apologize that its messy and not complete. I needed to get something out there.]
LLMs have offered such a huge boost towards AGI because they bootstrap the ability to reason by mimicing human reasoning.
Achieving this level of intelligence or even general knowledge through RL seems hardly more plausible now than at the inception of RL. Impressive progress has been made (Deepmind's AdA learning... (read 2978 more words →)
There is a lot of sarcasm out there on the internet. since GPT-3 was trained on a web crawl its likely it would spit out a lot of seeming nonesense, though its just trying to mimic our flippancy and random humour. Even the AI dungeon finetuning likely had a disproportionate amount of sarcasm and more concerningly really wacky and seemingly impossible events in an attempt by the human dungeons masters at creating humour and excitement, leading to a lot of unpredictability and wackiness that the model has learnt to mimic. I think it doesnt get enough credit when it comes to this, and what often seems like a stupid mistake it... (read more)