This is a special post for quick takes by Nisan. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
Comment Permalink
GPT = Generative Pre-Training?
Everyone thinks GPT stands for "Generative Pre-trained Transformer". (For example, Wikipedia.) Does it really? The earliest mention of "GPT" is in the GPT-2 paper, which refers to "the OpenAI GPT model" and cites the GPT-1 paper. That paper does not contain the phrase "generative pre-trained transformer". But it does contain the phrase "generative pre-training", in the title and in the body, italicized.
13