Pio Borgelt

Hi LessWrong, I'm a 17yo independent researcher and this is my first real research in this field. I isolated a kinematic transition vector at Layer 15 that predicts factual correctness with 0.95 AUROC. Would love some good feedback! Crossposted from my substack. I wondered: Do LLMs even have any representation...

Hi LessWrong, I'm a 17yo independent researcher (EV grantee). I spent the last month probing Llama-3.1 on TPUs and found a structural mismatch between TruthfulQA and actual factual recall. I isolated a kinematic transition vector at Layer 15 that predicts factual correctness with 0.95 AUROC, but RLHF trains the output...