This is a special post for quick takes by Tomás B.. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
Dwarkesh asked a very interesting question in his Sutton interview, which Sutton wasn't really interested in replying to.
Dwarkesh notes that one idea for why the the bitter lesson was true is because general methods got to ride the wave of exponential computing power while knowledge engineering could not, as labour was comparatively fixed in supply. He then notices that post AGI labour supply will increase at a very rapid pace. And so he wonders, once the labour constraint is solved post AGI will GOFAI make a comeback? For we will then be able to afford the proverbial three billion philosophers writing lisp predicates or whatever various other kinds of high-labour AI techniques are possible.
On one hand, true, on the other, would it be then understandable anyway when it was all written by possibly superhuman AIs working at certainly superhuman speeds without supervision?
6Seth Herd
See also Inscrutability was always inevitable, right?