MATS Fellow:
Jessica Cooper (Rumbelow), Matthew Watkins
Authors:
Jessica Cooper, Matthew Watkins
Citations
Abstract:
Anomalous tokens: a mysterious failure mode for GPT (which reliably insulted Matthew).
We have found a set of anomalous tokens which result in a previously undocumented failure mode for GPT-2 and GPT-3 models. (The 'instruct' models “are particularly deranged” in this context, as janus has observed.)
Many of these tokens reliably break determinism in the OpenAI GPT-3 playground at temperature 0 (which theoretically shouldn't happen).
What Happens When Superhuman AIs Compete for Control?
Authors:
Steven Veld
Date:
January 11, 2026
Citations:
0
AI Futures Model: Timelines & Takeoff
Authors:
Brendan Halstead, Alex Kastner
Date:
December 30, 2025
Citations:
0