Openai is exploring how to make artificial intelligence erotica
Providing Legal Porn via Artificial Intelligence (AAI): Insights from 404 Media and Microsoft’s NSFW Policy
It might be possible that less harmful cases will be allowed in the future, but the porn will be blocked if malicious actors try to put it online.
The revelation that was hidden in a document meant to gather feedback on rules for products was a worry for watchers of artificial intelligence, given the number of times it has been used to create deep fake porn.
“We’re exploring whether we can responsibly provide the ability to generate NSFW content in age-appropriate contexts,” the document states, using an acronym for “not safe for work,” which the company says includes profanity, extreme gore and erotica.
“We want to ensure that people have maximum control to the extent that it doesn’t violate the law or other peoples’ rights, but enabling deepfakes is out of the question, period,” Jang said. “This doesn’t mean that we are trying now to create AI porn.”
While Jang stresses that starting a debate about OpenAI re-evaluating its NSFW policy does not necessarily suggest drastic rule changes are afoot, the discussion comes during a fraught moment for the proliferation of harmful AI images.
A new class of artificial intelligence services can “nudify” images of people at the same time, a problem that has arisen as alarming as peer sexual exploitation in schools.
Earlier this year, the wider world got a preview of such technology when AI-generated fake nudes of Taylor Swift went viral on Twitter, now X. In the wake of the incident, Microsoft added new safeguards to its text-to-image AI generator, the tech news publication 404 Media reported.
As long as it is not abusive or breaks any laws, the chatbot may be able to answer that as a form of creative expression.
Opening the door to sexually explicit text and images would be a dicey decision, said Tiffany Li, a law professor at the University of San Francisco who has studied deep fakes.
Li said the harm may outweigh the benefit. They have to be very careful with this and it’s an admirable goal to explore it for educational purposes.
“People shouldn’t get it from open source models that don’t because it can be dangerous, but they should offer legal porn with safety in mind,” DiResta said.
Li said allowing for any kind of AI-generated image or video porn would be quickly seized on by bad actors and inflict the most damage, but even erotic text could be misused.
“Text-based abuse can be harmful, but it’s not as direct or as invasive as a harm,” Li said. It could be used in a romance scam. That could be a problem.”
OpenAI is Exploring Content Generation with the Model Spec, and Its Impact on OpenAI’s Innovation Strategy and Development Processes
Grace said the Model Spec was designed to bring more transparency to the development process and get feedback from the public, policymakers, and other stakeholders. She declined to share details of what OpenAI’s exploration of explicit content generation involves or what feedback the company has received on the idea.