Top postsTop post
Recently, I was reading anthropic's paper on NLA's[1] and for a person who works on steering, it was an interesting and thought-provoking paper. In this post I would like to go through my reproduction and some of the experiments I did on them. Training and Architecture I'm going to touch...
I'm gonna keep this post very dense and short, because I wrote a long one and got rejected by the moderation. haha. Everyone assumes that the value in activation steering must be hand-tuned for steering to work, previous works either inject using the same values of for all layer or...