LESSWRONG
LW

1438
Charles Martin
2010
Message
Dialogue
Subscribe

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
No posts to display.
No wikitag contributions to display.
Basic Facts about Language Model Internals
Charles Martin3y30

The PowerLaw behavior has been noted for some time.  See https://weightwatcher.ai  and the publications in JMLR and Nature Communications.
 

Reply