Humans can (almost) natively read neural network weights
Takehi et al. report that GPT-6-Astra can intuit the functions of neural networks by performing static analysis of the weights. I argue that, for at least two of these experiments, this is much more a feat of numerical gestalt than of mechanistic understanding. In the first experiment, Astra is given...
Nov 510