LESSWRONG
LW

139
Daan
40110
Message
Dialogue
Subscribe

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
No wikitag contributions to display.
Estimating efficiency improvements in LLM pre-training
Daan2y10

Thanks for the comment! I agree that would be a good way to more systematically measure algorithmic efficiency improvements. You won't be able to infer the effects of differences in data quality though - or are you suggesting you think those are very limited anyway?

Reply
42Estimating efficiency improvements in LLM pre-training
2y
3