I don't have very short timelines either, and I kind of resonate with parts of your argument. I think:
LLMs do greatly struggle with certain kinds of (high-level, broad) thinking, and they have improved in this axis far less than on other axes.
This limitation seems to be at least partly related to the architecture/training methodology of current LLMs.
LLMs have also improved much more on easy-to-measure capabilities, like math and coding, and have become reward-hacking demons on things that are hard to measure. LLMs are becoming less honest, for example. Maybe less honest than before post-training? Mainly concerned with superficially appearing honest, even if they have to lie to do it.
This limitation seems to be related to how RL training is currently done, and it's hard for me to even imagine what a proper fix would look like.
However, I disagree with you because:
Some progress has been made with respect to the types of thinking LLMs struggle with. Much less than most non-coders (who do not use AI in a way that bumps against novel, cognitively complex problems where failure is visible) seem to think, but real progress still. I do resonate a lot with the comment you linked.
Some of the limitations of current AI could be due to current architecture or training methodology, rather than something that could not be overcome except by some crazy breakthrough. In fact, for each limitation I see, I believe this is likely the case. I basically take a position of "who knows" for how long it'll take to address these problems. 6 months or 60 years wouldn't surprise me. I wonder why you think it's actually impossible?
I also agree that RSI will probably require a lot of hard cognitive thinking of the type LLMs are currently very bad at. However, I do leave open the possibility that we could hill-climb our way to superintelligence. For example, rather than discovering some breakthrough that allows for feasible online learning, we just find slightly better and better ways of allowing the model to think differently based on what it's learned so far in a session, and in the end we basically have online learning. I think this does require good training measures, and as I mentioned before, RL has a problem of not being able to measure what we want properly, so that's one reason to think developing hard-to-measure cognitive abilities may be extra hard. But I'm still open-minded. Do you think this can't happen?
I also found it strange that your timelines are shorter than mine, despite making a stronger argument than me. If I believed your #1 argument the way you stated it, I would think 2030 to 2035 would be very early.