This is a special post for quick takes by deepy. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
Feasible hardware verification is a big crux for me when it comes to how easy it will be to regulate AI. I recently heard about Talaas, which has produced an ASIC for Llama 3.1 8B. It seems like a great verification mechanism would be to only produce such chips, that allow you to only accelerate inference and not training, and only for a specific model (modulo LoRA). They were recently acquired by AMD. Right now it doesn't look like their chips provide a particularly useful context window, but latency seems absurdly low, and throughput absurdly high.
It also solves a pretty significant hardware security issue of ensuring the model you expect to run is the one you are actually running (but perhaps LoRA support messes with this too much?), and it makes it much much harder to exfiltrate model weights.
Still allowing transformer inference specific compute like from Etched seems weaker, especially if you want to have very concrete prevention of RSI, but would still be a good step.
In general, chip fabrication is a much easier part of the supply chain to regulate and monitor than end users of hardware.
MIRI (amongst others) have already written about inference-specialized compute in general.