Jeffery Reid

We've been experimenting with a small inference-time "attractor layer"... basically trying to get a lightweight stateful influence on generation without touching weights or training. Early results are interesting... stable perplexity, small gain on one task, and a pretty spectacular failure mode that I think is worth sharing. This has some...

We experimented with a small inference-time “attractor layer” designed to provide a lightweight, stateful influence on generation without modifying weights or training anything. Early results show stable perplexity, a small task-specific gain, and a very clear failure mode that feels worth sharing — especially for anyone thinking about dynamic memory...