skunnavakkam

I think that preventing suffering is more important than causing happiness, and I try my best to prevent the suffering of all things that I consider moral subjects. To this extent, I'm vegan, donate my money to effective charities, and so forth. At the time of writing, I'm thinking a...

In this post, I claim a few things and offer some evidence for these claims. Among these things are: * Language models have many redundant attention heads for a given task * In context learning works through addition of features, which are learnt through Bayesian updates * The model likely...