Great, lucid post. I agree that we don't know if the net result could be negative. Sometimes you don't only look for positive returns like on a balance sheet, but more like a beneficial process. The process itself helps guide some important choices that may not be entirely associated with this field of research for now.
In a way, some people might think AI is nearly at a mature state because of the last couple of years' acceleration. I don't think it is. AI is still in its juvenile stage, and we have a long way to go before security, for instance, is well u...
Great article. The min/max part and the idea of understanding the dynamics instead of optimizing blindly both really spoke to me.
I have a direction I’d like to suggest about the retrying part. In your study, the model is frozen. When its action gets blocked, it can adapt, but only in the moment, within the current session. Once that ends, it’s forgotten and the model has to start over.
But retrying also produces data. Every time it works, it creates a small sequence: an action gets blocked, you explain why, and the model proposes a new one that passes. That...
We probably know most of them but not all. The real difference might be that they need to reshuffle in importance from time to time. A paradigm shift can bring known-but-minor ones back to the surface, and make new ones appear around them.