OpenAI limits weapons info for teens on ChatGPT to prevent violence
The company tightens safeguards on ChatGPT's teen experience and rolls out automatic chat termination for fixation on violence.
What to know
- OpenAI is restricting weapons information ChatGPT provides to teens, even when questions appear harmless, citing violence-prevention goals.
- New safeguards include automatic chat termination for fixation on violence, account pauses for repeat offenders, and parent notifications.
- The rollout begins in the next few weeks as AI companies face growing scrutiny over chatbot risks to young users.
- A recent Common Sense Media report found OpenAI's teen safety alerts for suicide and self-harm were often late or absent.
“A report by non-profit Common Sense Media earlier this month found that ChatGPT's teen version often alerted parents late or not at all when teen accounts held conversations about suicide, self-harm or eating disorders”
Common Sense Media · Channel News Asia ↗
OpenAI AI company implementing safeguardsCommon Sense Media Non-profit research organization
How it unfolded 1 development · click the chart to see its coverage articles
-
1
Company strengthens age detection and plans rollout in coming weeks
OpenAI said it strengthened its age prediction system to move users it estimates are under 18 into the teen experience. The new safeguards will begin rolling out in the next few weeks and will be refined over time.
“OpenAI will restrict practical information on weapons and security systems that could be misused, with the limits applying to teens even when there is no sign of violent intent…”
— OpenAI · source -
background
OpenAI restricts details on mass attacks across all user bases — OpenAI is limiting detail on past mass attacks for all users, including the weapons used and how they were obtained, as part of the broader safety initiative.
-
background
ChatGPT to auto-end chats fixating on violence and pause repeat accounts — For all users, ChatGPT will automatically end chats where someone appears fixated on violence, and OpenAI may temporarily pause accounts after multiple such instances. Parents will be notified if their teen's account is paused for repeatedly discussing violence.
-
background
OpenAI announces teen safety restrictions on weapons information — OpenAI said it is tightening limits on weapons-related information ChatGPT provides to teens, with restrictions applying even when questions appear harmless. The move addresses growing scrutiny over chatbot risks to young users.
Also covered reported alongside — the timeline has no entry for these yet
-
first by NewsMax.com, 12d ago · also Reuters, The Hindu, Investing.com News, Channel News Asia