Newbie questions about information theory and transformers
I have some very naive (and unfortunately sort of stream-of-consciousness) questions brought up by this post: https://www.lesswrong.com/posts/vAAneYowLkaHnihCg/textbooks-are-all-you-need I definitely know that my ideas are poorly formed and I have no idea what I'm talking about. I'm happy to be told that my whole picture here is fundamentally flawed, or that...
Jun 21, 202310