I'm currently thinking about generative AI and content moderation through the lens of freedom of thought/expression. The basic idea is that generative AI will likely be integrated into all our creative tools (e. g. word processors and image editing software) – and that that will come with the need for...
“So you’re telling me we can’t believe anything we’re shown anymore?” I’m asking. “That everything is altered? That everything’s a lie? That everyone will believe this?” “That’s a fact,” Palakon says. “So what’s true, then?” I cry out. “Nothing, Victor,” Palakon says. “There are different truths.” Bret Easton Ellis –...
Maybe I should clarify what I mean by "content moderation". I use the term more loosely than just platforms filtering what can be shared. I think we will hear demands for moderation wherever generative AI is used. Example: Microsoft is going to integrate generative AI into Word. The second they do this, they run into all the content moderation questions OpenAI has with ChatGPT. What if I want to write a story about [morally unacceptable thing], will AI assist me in fleshing out the details of [repugnant scene] or not? If not, will it help me to write the rest of the story or will it block me the moment its content... (read more)
Thanks, I'll check it out. At the moment, I'm fine with looking at all sorts of arguments; though I'm already pretty horrified by the ways this might be used to censor and control.
Agreed, good point! Let's say there will be non-stupid arguments in favor of content moderation. For example (top of my head):
I tend to think it's better to limit the model's capability so it fits the use case (e. g. no ability to create porn in software used by children) than having a Llama Guard style moderation tool in the loop... (read more)
I'm currently thinking about generative AI and content moderation through the lens of freedom of thought/expression. The basic idea is that generative AI will likely be integrated into all our creative tools (e. g. word processors and image editing software) – and that that will come with the need for content moderation. We might end up in a situation that is as if a pen would be able to prevent us from drawing/writing and/or sharing the "wrong" thing (and to tell on us, if we tried).
To me this seems to be a source of a lot of power. Whoever produces and controls the moderation tools gets to decide questions like: What is... (read more)
Well, thanks for reading five of them :) I'll try to answer your concerns:
Film:
Film is a good argument, but mostly shows that we can handle "fakes" when framed right, e. g. when they are presented with context clues marking them as a movie. Generated images will not only often lack that framing, but will be presented to us framed as if they were representing something real. I would argue that this will devalue the context clues and makes it difficult/impossible to tell which images are real and which are generated in general.
X-risk compared to human level AI:
a) Political/societal destabilization while nukes are a thing = bad. Or more general: This interferes with... (read more)
“So you’re telling me we can’t believe anything we’re shown anymore?” I’m asking. “That everything is altered? That everything’s a lie? That everyone will believe this?” “That’s a fact,” Palakon says. “So what’s true, then?” I cry out. “Nothing, Victor,” Palakon says. “There are different truths.”
Bret Easton Ellis – Glamorama, 1998
Photography has played a major role in allowing us to construct an understanding of the world whose general outlines are shared by billions of people. Functionally, photographic images extend our senses and tell us about the world outside of our immediate here and now. They are among the most important epistemological tools of humanity. Even today, after the transition to digital has... (read 8515 more words →)
Yeah, this is the kind of argument I run into when trying to find something about his topic. It's mostly people arguing for the rights of communities to use moderation and how that is not censorship. It's not primarily what I'm thinking about though. I'm thinking about situations where I'm working on a piece of text (or an image) and make use of generative AI in my workflow. Will MS word prevent me from writing certain stories? I also tried to clarify this a bit more above in my answer to Dagon. See there for more detail (if you're interested).