This is a special post for quick takes by Haoxing Du. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
A couple of weeks ago, Shin Jin-seo defeated KataGo 2-1 with only a 2-stone handicap. (News article, Reddit) I thought that KataGo at its current strength is far, far ahead of any human player, and found this very surprising! As far as I can tell Shin's victory was also not due to exploiting adversarial examples like this one. What to make of this?
2 stones is a substantial handicap at high levels. The saying I recall from the pre-Go-AI days was that a Go grandmaster would take a three-stone handicap to play against God.
13Vladimir_Nesov
Apparently this is not very far from how things looked like 2 years ago. KataGo's biggest models are less than 1 GB in size. Transformer support was just added in the latest major release, stating that transformers are "generally much stronger given the same compute cost" compared to the current model architecture. So probably a correctly trained 1B param dense transformer is stronger.
The biggest LLMs of 2026 (Mythos 5, probably Astra) likely have about 1T active params (and 10T total). It's a miracle of narrow AI that KataGo is still so strong.
I'm not sure how to think about the number of parameters required to be good at Go compared to the number of parameters in frontier LLMs. It seems not thaaaat surprising to me if much fewer parameters are required to be vastly superhuman in Go. In the last domain that I worked in, AI for weather forecasting, it's possible to outperform the best physics-based models with O(100M) parameters.
The first comment on the Reddit post you linked quotes rating estimates that put Shin Jin-seo as comparable to AlphaGo Lee (AlphaGo Lee 3040, Shin JinSeo 3060). But I hav... (read more)