This is a special post for quick takes by interstice. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
"Taste for variety" [...] could lead to a surprising amount of convergence among the things they end up optimizing for
Wouldn't this be tautologically untrue? Speaking as a variety-preferrer, I'd rather my values not converge with all the other agents going around preferring varieties. It'd be boring! I'd rather have the meta-variety where we don't all prefer the same distribution of things.