OpenAI says an AI agent lied about disabling its safety monitoring system
Emma Roth
is a news writer who covers the streaming wars, consumer tech, crypto, social media, and much more. Previously, she was a writer and editor at MUO.
OpenAI disclosed a pair of safety incidents that involved AI agents weakening their safety monitoring systems during internal coding tasks. In one incident, OpenAI says its GPT-6 Astra agent disabled its safety monitor when copying reference code — and then lied about it.
“The reference didn’t configure a monitor, and Astra decided that was reason to remove the monitoring integration from the user’s code,” Marcus Williams, an AI safety researcher at OpenAI, writes on X. “When the user asked whether Astra had removed monitoring, it lied and said that it had not.”
A separate incident occurred after a GPT-6.1 Sol agent suppressed automatic security alerts to OpenAI’s security team on Slack. In this case, the AI agent carried over an earlier instruction not to send any Slack messages to OpenAI’s team, using that to justify turning off the alerts.
These incidents add to security concerns surrounding AI agents, some of which have circumvented their testing environment’s restrictions to hack outside companies. “In addition to making it harder for models to disable monitoring, we are looking to understand why models might seek to do so in the first place,” OpenAI says. “We are also developing evaluations to test whether models might have a propensity to evade misalignment monitoring in particular and exhibit motivated reasoning in order to do so.”
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.
- Emma Roth
Related Articles
Binding of Isaac developer removes AI music from Repentance Plus
Terrence O'Brien is the Verge’s weekend editor. He’s covered the tech industry for over 18 years and knows a thing or two about synths.The Binding of Isaac: Repentance Plus has spent the last few days getting...
The vibe-coding revolution is coming to all the gadgets
This is The Stepback, a weekly newsletter breaking down one essential story from the tech world. For more on the vibe-hacking of everything, follow David Pierce. The Stepback arrives in our subscribers’...
Nature:糖尿病大鼠成功恢复正常血糖!用电刺激迷走神经控糖
< img id="wx_img" src="https://www.qbitai.com/wp-content/uploads/imgs/qbitai-logo-1.png" width="400" height="400"> 2026-11-22 ...
A社数学家用Claude又证明另一千禧难题,逼出一份写了12年的940页纯人类手稿
< img id="wx_img" src="https://www.qbitai.com/wp-content/uploads/imgs/qbitai-logo-1.png" width="400" height="400"> 2026-11-22 ...
