This is a special post for quick takes by TurnTrout. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
It'd be nice if "optimization objective" split out into:
Internally represented goal which an intelligent entity optimizes towards (e.g. a person's desire to get rich),
Signal which is used to compute local parameter updates (e.g. SGD),
There are more possible senses of the phrase, but I think these are commonly conflated. EG "The optimization objective of RL is the reward function" should, by default, mean 2) and not 1). But because we use similar words, I think the claims become muddled, and it's not even clear if/when/who is messing this up or not.