LESSWRONGTags
LW

Glitch Tokens

•

Applied to What's up with all the non-Mormons? Weirdly specific universalities across LLMs by mwatkins 5d ago

•

Applied to An examination of GPT-2's boring yet effective glitch by MiguelDev 11d ago

•

Applied to Anomalous tokens reveal the original identities of Instruct models by MiguelDev 3mo ago

•

Applied to ' petertodd'’s last stand: The final days of open GPT-3 research by mwatkins 3mo ago

•

Applied to Mapping the semantic void: Strange goings-on in GPT embedding spaces by jacobjacob 4mo ago

•

Applied to Linear encoding of character-level information in GPT-J token embeddings by mwatkins 5mo ago

•

Applied to <|endoftext|> is a vanishing text? by MiguelDev 7mo ago

•

Applied to The "spelling miracle": GPT-3 spelling abilities and glitch tokens revisited by duck_master 9mo ago

•

Applied to (redacted) Anomalous tokens might disproportionately affect complex language tasks by nikola 11mo ago

•

Applied to A Search for More ChatGPT / GPT-3.5 / GPT-4 "Unspeakable" Glitch Tokens by Martin Fell 1y ago

CronoDAS v1.1.0Apr 18th 2023 (+18/-25) 6

Glitch Tokens are tokens in a language model that cause anomalous output, such as ~~SolidGoldMagickCarp(sp?)~~ SolidGoldMagikarp.

•

Applied to SmartyHeaderCode: anomalous tokens for GPT3.5 and GPT-4 by AdamYedidia 1y ago

•

Applied to The ‘ petertodd’ phenomenon by mwatkins 1y ago

•

Applied to SolidGoldMagikarp III: Glitch token archaeology by plex 1y ago

•

Applied to SolidGoldMagikarp (plus, prompt generation) by plex 1y ago

•

Applied to SolidGoldMagikarp II: technical details and more recent findings by plex 1y ago

•

Applied to Nokens: A potential method of investigating glitch tokens by Raemon 1y ago

Raemon v1.0.0Mar 15th 2023 (+107) 6

Glitch Tokens are tokens in a language model that cause anomalous output, such as SolidGoldMagickCarp(sp?)

•

Created by Raemon at 1y