A crisis for online communication: bots and bot users will overrun the Internet?
10mruwnik
5Dagon
2Mitchell_Porter
2Dagon
4Coafos
4Slider
2Soka Ukuri
1RomanHauksson
3Lao Mein
9Dagon
2Dagon
New Comment
I'd like to hear a clearer problem statement. The vast majority of my online consumption is for entertainment, or information, and I don't much care whether it was created or compiled by a human individual, a committee or corporation, or an AI, or some combination of them.
I do often care about the quality or expected quality, and that's based on the source and history and reputation, and applies regardless of the mechanics of generating the content.
I do often care about the quality
One possibility, surely just one possibility among many, is that a forum could be destroyed by being flooded with bots, using fictitious identities to talk pointlessly to each other about their fictitious opinions and their fictitious lives.
There is such a thing as online community, and advanced chatbots can be the death of it, in various ways.
edit:
I don't much care whether it was created or compiled by a human individual, a committee or corporation, or an AI, or some combination of them.
Are there any circumstances in which you do care whether the people you are talking with are real, or are fictitious and AI-generated?
is that a forum could be destroyed by being flooded with bots, using fictitious identities to talk pointlessly to each other about their fictitious opinions and their fictitious lives.
The word "fictitious" in that description feels weird to me. MOST random talk on forums is flooded with unknown people, using online identities to talk pointlessly to each other about their poorly-supported beliefs and heavily-filtered lives. At least a bot will use good grammar when I ignore it.
If you're describing a specific forum, say LessWrong, this still applies - there's lots of crap I don't care about, and glide on past. I recognize some posters, and spend the time on some topics to decide if an unknown poster is worth reading. Adding bot accounts will create more chaff, and I will probably need better filtering mechanisms, but it won't reduce the value of many of the great posts and comments.
Are there any circumstances in which you do care whether the people you are talking with are real
I'm not actually sure whether I'd care or not, if the 'bot were good enough (none yet are). In most short online interactions, like for this site, if I can't tell, I don't care. In long-form interactions, where there is repeated context and shared discovery of each other (including in-person friendships and relationships, and most work relationships, even if we've not met in person), I don't directly care, but AI and chatbots just aren't good enough yet.
Note that I DO really despise when a human uses AI to generate some text, but then doesn't actually verify that it matches the human's beliefs, and takes no responsibility for posting verbose crap. I despise posting of crap by biological intelligences as well, so that's not directly a problem with 'bots.
Marketers, scammers and trolls are trying-to control the internet bottom-up, joining the ranks of the users and going against internet institutions. While it's a problem (a possibly big one), a worse situation is when the internet instutions themselves start using LLMs for top-down control. For a fictional example, see heaven banning.
"passing" for online seems easier. I tried to think whether I can come up with the easiest task to do it with. Writing Nigerian Prince letters has the wierd property that low quality is part of the success formula, those fish that bite are in a sense guaranteed to be gullible. That is also an awfully fitting training signal, whether a user replied or not. Incoherrent scenarios which have a vague promise of easy money does not seem too challenging a literary genre.
If ignoring ceases to be an effective strategy against spam it is going to be an unpleasant development.
It seems more likely to me that the internet is going to become relatively deanonymized than that it's going to be destroyed by bots. E.g. I weakly expect that LessWrong will make it much harder for new users to post comments or articles by 2024 in an effort to specifically prevent spam / propaganda from bots.
Maybe the internet will break down into a collection of walled gardens. Maybe services will start charging token fees to join as an easy way to restrict how many accounts spammers can have (at the cost of systematically excluding their poorest users...)
Is there any way to use cryptography to enable users to verify their humanity to a website, without revealing their identity? Maybe by "outsourcing" the verification to another entity – e.g. governments distribute private keys to each citizen, which the citizen uses to generate anonymous but verifiable codes to give to websites.
You can, for example, hash your gmail address and an authentication code from a Google two-factor-authentication app to any website that wants to confirm you're human. The website then uploads to hash to a Google API. Google verifies that you are both using a human gmail account (with a registered credit card, phone number, ect.) and are posting at a human-possible rate. The website then allows you to post.
So it can already be done with existing services. There's probably a specific Google API that does exactly that.
Wait, what? That doesn't verify humanity, it only verifies that the sending agent has access to that gmail account. AI (and the humans who're profiting off use of AI) have all the gmail accounts they need.
There's probably no cryptography operation that a human can do which a LLM or automated system can't. Any crypto signature or verification you're doing to prevent humans impersonating other humans will continue to work, but how many people do you interact with that you know well enough to exchange keys offline to be sure it's really them?
Curated and popular this week