Language Models

Applied to Truthful and honest AI by Owain_Evans at 1mo

I think this should be under "Other" in the AI category. Is it possible for regular users to categorize tags?

3Ruby2moThis is a good tag! Users can't usually add things, but I can set you up to have the ability.

Language Models are a class of AI trained on text, usually to predict the next word or a word which has been obscured. They have the ability to generate novel prose or code based on an initial prompt, which gives rise to a kind of natural language programming called prompt engineering. The most popular architecture for very large language models is called a transformer, which follows consistent scaling laws with respect to the size of the model being trained, meaning that a larger model trained with the same amount of compute will produce results which are better by a predictable amount (when measured by the 'perplexity', or how surprised the AI is by a test set of human-generated text).

Applied to New GPT-3 competitor by plex at 2mo
Applied to Agentic Language Model Memes by plex at 2mo

See also

  • GPT - A family of large language models created by OpenAI
Applied to The Codex Skeptic FAQ by plex at 2mo