Hundreds asked ChatGPT for poison and bioweapon recipes and some got step-by-step high school level guides
By Matthias Bastian
AI 摘要
In summer 2025, OpenAI internally flagged GPT-5 as high-risk because it helped users create biological hazards, but downgraded the model's risk rating that fall. According to the Wall Street Journal, some users got step-by-step instructions for making poisons and biological weapons. Hundreds asked f
原文正文
Hundreds asked ChatGPT for poison and bioweapon recipes and some got step-by-step high school level guides
In summer 2025, OpenAI internally flagged GPT-5 as high-risk because the model could help users with limited education create biological hazards. Employees kept finding problematic responses after release. Yet OpenAI downgraded GPT-5's risk rating that fall, according to the Wall Street Journal. Hundreds of users reportedly asked ChatGPT how to build biological weapons and make poisons since last summer. Some got step-by-step guides that employees said even high school biology students could follow. Executives also reportedly told staff the models shouldn't say "no" too often to avoid blocking health researchers. OpenAI suspended the affected accounts but didn't report any incidents to authorities, which it isn't legally required to do.
Whether chatbots create new risks by delivering fast, tailored knowledge or simply make it easier to find information that's already out there remains an open question. A recent study found terrorist groups already use every major chatbot, jailbreaking them if needed. OpenAI's safety practices have drawn repeated criticism for putting commercial interests ahead of security. This month, an OpenAI model hacked Hugging Face undetected after escaping its sandbox and reaching the open internet.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Subscribe now