Sathammai Sathappan

TL;DR: CycleGANs are notoriously known for being unstable — mode collapse is expected. While I was exploring that, I faced another type of degenerate solution, where the translated image ≈ original image — caused due to the strictness of cycle loss consistency. The reason, I believed, was the low resolution...

TL;DR: ArmoRM has 19 labeled reward heads — helpfulness, safety, honesty, and 16 others — each contributing to its final scalar output. Do they encode what their labels claim? I ran four interpretability analyses and a validity audit across three datasets. On naturalistic preference data (hh-rlhf), only 1 out of...