OpenAI is introducing stricter safety measures on ChatGPT to protect teenagers from potentially harmful information and prevent real-world violence. The company has announced additional restrictions on weapons-related content that teenage users can access, even when their questions appear harmless.
Under the new measures, ChatGPT will limit practical information about weapons and security systems that could potentially be misused to facilitate violence. These restrictions will apply to users under 18 as part of the platform’s enhanced teen safety protections.OpenAI is also strengthening safeguards for all users. If a conversation indicates that someone is repeatedly focusing on violence or expressing intentions to seriously harm another person, ChatGPT may automatically end the conversation. In cases where multiple such conversations are interrupted, the company may temporarily suspend the account.
Additionally, OpenAI is strengthening its age-prediction system to identify users who may be under 18 and automatically move eligible accounts into the ChatGPT for Teens experience. The company also plans to notify parents if their teenager’s account is temporarily paused following repeated violence-related conversations.The new measures are part of OpenAI’s broader efforts to make artificial intelligence safer for younger users amid growing concerns about the potential misuse of AI tools.
OpenAI has stated that the additional safeguards will be rolled out in the coming weeks and will continue to be improved.
