Razied

To clarify definitions a bit, by GPT-N I mean a future deep learning model trained to minimize the error of next-word prediction on a corpus that includes substantial portions of the internet. This model is assumed to be superhuman at its given task. There are only 2 requirements on the...

Suppose you are an extremely talented but still unknown machine learning researcher (like Einstein of patent-clerk days), and you discover something very important, maybe a few tricks that allow you to train neural nets 4 orders of magnitude faster than anyone else. You can train something of GPT-3 level on...