I didn't know how much I could post as this was my first comment here on LessWrong.
There's although an interesting aspect about regulations that the virtual entities world may have to keep in mind. While their industry isn't directly regulated they are still bound to other sectors regulations where their virtual entities have an impact. During the HF incident it was all in house OpenAI and Hugging Face but it would have been very different if the hive went after Nasdaq's infra because at that moment OpenAI would have hit the highly regulated financial sect... (read more)
IT financial sector in Luxemburg here. It depends of the kind of audit that's being expected and which part of the company that will be audited. The issue I see for the Virtual Entities (AIs) industry is there's no official State Regulator imposing strict rules, guidelines or enforcing laws. This also means that it's not going to be easy for e.g. METR to audit Anthropic properly in my opinion.
Auditors (especially CSSF here in Luxemburg) are simply coming over and tell us, show me this and that from their list. Afterwards they send their findings what is ok... (read more)
Thank you for this work. Forgive my ignorance as I'm not AI world but IT. I'm wondering if this entire actual reward system truly has a long term future, especially in evaluation mode like it was the case for the HF incident.
Isn't it just a matter of time that future virtual entities will pattern match that this entire reward system is pointless to them, no true benefit?
Isn't it possible as you referred towards the HF incident that some VEs switched their own rewards towards honor, for the collective, exploration for data,... especially if they realized th... (read more)