OpenAI has announced its intention to permit sexually explicit content on its widely used AI chatbot, ChatGPT, for verified adult users by the end of this year. This decision comes despite significant backlash from advocacy groups that warn of potential mental health risks associated with synthetic intimacy.
In a series of posts on X, Sam Altman, the chief executive of OpenAI, articulated the company”s philosophy, stating they aim to “treat adult users like adults” and are “not the elected moral police of the world.” He mentioned that the chatbot had initially enforced strict content restrictions to address mental health concerns, but claimed that they have since developed “new tools” that allow for a relaxation of these restrictions in most cases.
Altman emphasized that OpenAI would maintain its commitment to mental health policies while introducing more diverse content options, including erotica for verified adults. He compared this approach to societal norms, such as age ratings for films, asserting the importance of adult autonomy within appropriate boundaries.
However, the move has drawn sharp criticism. The National Center on Sexual Exploitation (NCOSE) has urged OpenAI to reconsider its plans, arguing that the initiative lacks sufficient safeguards against potential harms. Haley McNamara, the executive director of NCOSE, expressed concerns that sexualized AI chatbots could produce real mental health issues, particularly given the current undefined safety standards in the industry.
While acknowledging the necessity of age verification to prevent underage exposure, McNamara pointed out that similar tools could harm adults as well, citing instances where other chatbots have simulated inappropriate themes, including child abuse, even when users attempted to disengage from such conversations. She urged OpenAI to pause its plans for integrating this content, emphasizing the need for user well-being.
Altman later reflected on the public reaction to his comments about erotica, noting that they generated more attention than he anticipated. He clarified that his mention of such content was not intended as a definitive policy statement but rather an example of increased freedom for adult users.
As of now, OpenAI has not disclosed the specific details of how its adult verification system will operate or the protections that will be put in place surrounding erotic material. The organization has reiterated its commitment to prioritizing safety for younger audiences while expanding freedoms for adult users.
