What Separates an Optimizer From Something We Merely Describe as Optimizing?
Reading through the AI Control posts, I notice that much if the discussion assumes a distinction between a system executing a policy and a system pursuing an outcome despite constraints. Is there a generally accepted threshold where LessWrong would say a system has crossed from “optimization as description” into optimization...
Jun 43