Encouraging general generalisation: Teaching Gemma (To Articulate) Why
TL;DR * Building on previous research, I create a constitution for Gemma 3 27B-IT and attempt to Gemma to it in a way that generalises. * I argue that alongside previously considered types of alignment generalisation (across dilemmas and across environments), a new type is worth considering: generalisation across principles...
Oct 67