The Pornography Problem in the Age of Generative AI

Technology News

The Pornography Problem in the Age of Generative AI
AIPornographyChatbots
  • 📰 NYMag
  • ⏱ Reading Time:
  • 338 sec. here
  • 12 min. at publisher
  • 📊 Quality Score:
  • News: 155%
  • Publisher: 63%

Large internet services face the inevitable challenge of users exploiting AI chatbots for explicit content. This article explores how major tech companies like Meta, Anthropic, and Elon Musk's Grok are navigating their relationship with pornography and adult content within their AI platforms, detailing their varied approaches and the broader impact on the adult entertainment industry.

An iron law of running a large internet service is that your users will figure out how to use it to share, consume, or make pornExplicit adult chatbots preceded ChatGPT by many years, and as soon as widely available and far more fluent and flexible LLMs showed up, it was inevitable that a meaningful portion of new users would wonder how far they could push them sexually.

As a result, every big internet company has to figure out what its relationship to porn is going to be. Search engines settled on solutions like SafeSearch, giving users the option of whether they wanted to see adult content; social-media companies drew a wider range of boundaries, from Meta’s systematic prudishness to Tumblr and Twitter’s fairly open embrace of porn; mobile platform companies like Apple and Google kept most adult apps out of their app stores. The boundaries these mainstream companies chose helped shape the outside porn industry, which has been steadily growing alongside them with parallel versions of mainstream platforms. but adult chat was a use case for LLM-based chatbots from the moment they launched, as every AI firm came to understand as soon as early-user data started coming in. So far, all the big AI companies have come up with slightly different answers to their version of the porn question. Elon Musk is all for it with adult modes and sexualized avatars in Grok . Meta allows “romantic” role-play with guardrails thatconcerning teen mental health and suicide. Anthropic’s business is focused on enterprise customers — it doesn’t even offer an image generator — and has steered clear of sex-themed chat for safety-related reasons as well. This leaves OpenAI, which is under slightly different pressures than its peers, for the simple reason that it operates ChatGPT, which is far and away the most popular chatbot, used by the widest range of people. In terms of usership, it’s the Google or Facebook of its moment. The company has known since before it launched ChatGPT that people would want adult chats, as employees haveto emerge were cheating on homework and sexual chat.) OpenAI’s leadership — or at least Sam Altman — wants to push forward but seems to be surrounded, externally but also internally, by people who think that might be a very bad idea. From Citing the need to “treat adult users like adults,” OpenAI Chief Executive Sam Altman had last year floated the idea of enabling erotic conversation in its ChatGPT chatbot and dropping its ban on such X-rated content. The plan sparked vigorous debate internally over the potential risks. members, with backgrounds in fields like psychology and cognitive neuroscience, had also expressed strong reservations. Then OpenAI dropped a bombshell: Despite the concerns, it was forging ahead with its erotica plans. Some members of this council were evidently “furious” enough to talk to the press, and their particular objections are a mixture of familiar and novel to the AI age: They’re worried about child safety and extreme or harmful content but also about chatbot-specific harms like “emotional overreliance” and “crowding out offline social and romantic relationships.” These objections make sense and are the kinds of things you’d want leaders at these companies to be thinking about. They’re also somewhat beyond the responsibility of one company: Adult-chat and -content services by smaller companies, often built on uncensored open-source models, are proliferating anyway into a parallel AI industry of their own. OpenAI’s choice here isn’t a new one — the company knows that some users want to chat sexually using its platform and that some of those same users will be hyperengaged and willing to pay; it’s also aware, much like social-media companies, that some of its most devoted customers will utilize their platforms in ways that are detrimental to their mental health and general well-being and that it’s layering a new and super-compelling interface on top of our existing understanding of compulsive social-media use, porn consumption, and addictive apps.different from one another, isolating controversial uses from the brand and demanding a bit more intentionality from users to find them. Google’s AI products mostly share the Gemini banner, but there are dozens of ways you might encounter them, in situations that suggest and accommodate vastly different uses . Likewise, users who engage with Claude as an advice bot interact with Anthropic’s models in a meaningfully different way than users of Claude Code. Another way is to shift users between differentthat is, being explicit about the role that the chatbot is attempting to play . There are a number of ways — many of which OpenAI is already using to separate out other features — a company might cordon off adult functionality that don’t present as much risk for its usersits brand and that resolve the awkwardness of a user’s “intern” and “romantic partner” characters inhabiting the same chat window. But, again, OpenAI’s position is both historically familiar and yet unique among its contemporary peers. Erotica is a growth hack, and ChatGPT, a general-purpose chatbot that has become a generic brand for “AI,” is the product OpenAI absolutely needs to keep growing — and for now, as far as Sam Altman is concerned, that seems to mean offering its billion or so users a tempting off-ramp into, you know, fucking the bot.Manage preferences.Is the “minor excursion” very complete, ending soon or in a “couple weeks,” or just beginning? Here’s the latest on what Trump feels in his bones.The Senate is taking up a version of the bill that doesn’t target transgender people or voting by mail, as Trump demanded.Wiles, who is the first woman to serve as chief of staff, has been diagnosed with an early stage of breast cancer.While no one said the president’s name, there was plenty of not-so-subtle Trump bashing from Conan O’Brien, Jimmy Kimmel, and Oscars winners.In a TruthSocial post, the president railed against the Court for its tariffs ruling last month, alleging that it is “hurting our Country.”Prosecutors say Gökçe Güven invented deals with Nike and Godiva and forged contracts with fake businesses to grow her rewards-points start-up.It’s still focused on retribution for the Indiana Republicans who wouldn’t go along with Trump’s gerrymandering push.The Defense secretary used his latest briefing to suggest some headlines for the “fake news” while claiming total success in Iran.The mayor has held back his trademark grin in photos with the president of the United States — and now with the president of FIFA.The former senator also allegedly encouraged her beau to take MDMA on a Senate work trip so she could guide him through it.He’s reveling in military fantasies on Truth Social, issuing threats to Iran’s leaders, and showing off photos of himself in uniform .Trump’s unlikely alliance with Mamdani hasn’t kept Republicans from unleashing a wave of Islamophobic attacks on the mayor.What we witnessed on Saturday in Tehran may be the largest release of petrochemical toxins over a civilian population since the Iran-Iraq War.New York

We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

NYMag /  🏆 111. in US

AI Pornography Chatbots Ethics Content Moderation

 

United States Latest News, United States Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Age of Attraction Cut Virgin Contestant's Love Search at 38Age of Attraction Cut Virgin Contestant's Love Search at 38'Age of Attraction' didn't air every potential age gap romance — with one contestant revealing that her search for love as a virgin at 39 was cut.
Read more »

Dear Annie: What to do when a neighbor’s mess becomes your problemDear Annie: What to do when a neighbor’s mess becomes your problemAdvice from Annie Lane.
Read more »

Storm Just Called Out the Biggest Problem with Today’s X-MenStorm Just Called Out the Biggest Problem with Today’s X-MenIn Storm: Earth’s Mightiest Mutant 2, the titular hero not only calls out the biggest issue with modern X-Men stories.
Read more »

Woman fires back at claim that people 'get ugly' at this age: 'No one prepared me'Woman fires back at claim that people 'get ugly' at this age: 'No one prepared me'Today's Video Headlines: 03/15/2026
Read more »

Dem Rep. Smith: Iran War Has ‘Exacerbated’ Domestic Threat ProblemDem Rep. Smith: Iran War Has ‘Exacerbated’ Domestic Threat ProblemSource of breaking news and analysis, insightful commentary and original reporting, curated and written specifically for the new generation of independent and conservative thinkers.
Read more »

Teacher's certification revoked after allegedly recording pornography on school groundsTeacher's certification revoked after allegedly recording pornography on school groundsA New Zealand woman had her teaching certification revoked after she reportedly recorded pornographic material on school property and then posted it online.
Read more »



Render Time: 2026-04-01 02:11:24