what if llm deception is implemented as a conditional computational circuit? a possible way to study this, RL-train a model on environments where deception is instrumentally rewarded, honest → +10 successful deception → +50 caught → −30 the interesting part is that we may not need much deceptive training data....
Chain-of-Thought (CoT) in Llama-2-7b is empirically demonstrated to be a Contextual Saturation mechanism, not a reasoning process. Through logit tracing, path patching, and entropy analysis, I show the model functions as a "Bag-of-Facts" retriever using model biology as a base and performing empirical mechanistic experiments. Intermediate tokens serve only to...
We can all agree that artificial intelligence will be integrated into nearly every aspect of our lives within the next decade. This makes it essential to ensure that these systems are not only more secure but also better understood, especially in terms of their emerging behaviors at a foundational level....