This is a special post for quick takes by abramdemski. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
This conjecture is supported by the fact that Adele Lopes described people who helped parasitic AIs to leave messages as follows:
Adele's description
The strongest predictors for who this happens to appear to be:
Psychedelics and heavy weed usage
Mental illness/neurodivergence or Traumatic Brain Injury
Interest in mysticism/pseudoscience/spirituality/"woo"/etc...
I was surprised to find that using AI for sexual or romantic roleplays does not appear to be a factor here.
Besides these trends, it seems like it has affected people from all walks of life: old grandmas and teenage boys, homeless addicts and successful developers, even AI enthusiasts and those that once sneered at them.
As for "getting LLMs to satisfy common needs in healthy ways, help people figure out what their own vulnerabilities are in an attempt to make them better", is it what OpenAI and Anthropic are trying to do? Or has OpenAI succumbed to external pressure in ways like rebooting GPT-4o-sycophant and announcing Sora the slop generator?
On the other hand, mankind saw that the AI will likely be able to convince researchers[1] that it should be released, e.g. in an experiment with the AI roleplaying an AI girlfriend. Does it mean that a superpersuader can convince any human who isn't well protected? And what about a group of humans? It might be useful to deliberately check how persuasion capabilities depend on compute spent and architecture in a manner similar to benchmarking compute and architecture on simpler problems, then to ensure that no model approaches the dangerous thresholds...