x

LESSWRONG

LW

Arnel Malubay — LessWrong

Arnel Malubay

Arnel Malubay

Message

Hi! I'm Arnel Malubay, a data scientist who has recently taken an interest in technical AI safety research. My background is in Mathematics (undergrad) and Data Science (masters) and I also previously worked as a research fellow at the Marine Science Institute.

2

1

2mo

Arnel Malubay

Hi! I'm Arnel Malubay, a data scientist who has recently taken an interest in technical AI safety research. My background is in Mathematics (undergrad) and Data Science (masters) and I also previously worked as a research fellow at the Marine Science Institute.

Exploring multi-hop subliminal learning

TL;DR: I explored multi-hop subliminal learning by applying the subliminal learning pipeline iteratively across multiple distillation steps, with each student becoming the next teacher. For Qwen specifically, we see that longer training stabilizes the trait expression rate for a strong trait (e.g. cat-loving) but shorter training is more seed-unstable. For...