Agree that better to compare a human's learning lifetime (e.g. childhood and schooling) to the training time of the model. We all know evolution is extremely slow. But humans learn (train) a tremendous amount in their own lifetime -- Mandarin, English, etc. are not encoded in our DNA but learned in two years. Our genome is fairly small relative to the numbers we are talking here, right?
I'm confused by the 3000MW figure. I go to top 500 and see ~30,000KW, i.e. 30MW???
Agree that better to compare a human's learning lifetime (e.g. childhood and schooling) to the training time of the model. We all know evolution is extremely slow. But humans learn (train) a tremendous amount in their own lifetime -- Mandarin, English, etc. are not encoded in our DNA but learned in two years. Our genome is fairly small relative to the numbers we are talking here, right?
I'm confused by the 3000MW figure. I go to top 500 and see ~30,000KW, i.e. 30MW???