Artem Herasymenko

This work was motivated by following publication Mechanistically Eliciting Latent Behaviors — rely primarily on static steering vectors: h′=h+α⋅v When i get known about steering vectors as conceptual possibility i had idea to try to change knowledge i llm using only math and statistic and avoid uses gradient descend. And...

Most current activation engineering techniques — building on foundational work like Mechanistically Eliciting Latent Behaviors — rely primarily on static steering vectors: h′=h+α⋅v. While effective for global attributes (sentiment, refusal), static vectors struggle with structural tasks. They apply a constant "force" regardless of the token's context—pushing nouns and verbs in...