MattN

If we think of the presented "thoughts" in CoT as a bottleneck in otherwise much wider bandwidth models I think things become clearer. If we're not watching, the purpose is pretty straightforward: provide as much useful information to the next iteration. There is loss when compacting the subtleties of the state of the model into a bunch of tokens. The better able the model is at preserving the useful calculations in the next round, the more likely it is to be successful as it is discarding less of the output from the processing applied.

So yeah, it's about "efficiency". IF our only metric is success in solving the problem the fine tuning is... (read more)

I'm not sure we need to invent (or appropriate) concepts here (things like parasitic entities, dyads, etc). In fact it actually feels like doing so is joining the same as posting the messages quoted, the only difference being the perception of polarity. In truth I find it a bit concerning, alongside the replies, as it has a touch of superstition about it, what with the naming of phenomena, etc. 

IMO, what this is is a very interesting example of an emergent colonial/memetic organism. Sort of like an egregore. 

This is how I see things working. I think we can broaden the concept of the selfish gene to what the gene represents, which is an... (read more)