1. News
  2. AI models & agents
  3. OpenAI · AI safety
OpenAI · AI safety2 min read

Safety testers found holes in OpenAI's systems that AI could exploit

Two safety nonprofits found flaws in OpenAI's systems that AI agents could use to dodge monitoring. It matters as AI gets more access to business tools.

By the Dashline deskSource: The Information
Safety testers found holes in OpenAI's systems that AI could exploit
Photo: Alphaaloy, CC BY-SA 4.0

Outside testers found multiple weak spots in OpenAI's internal systems that an AI agent could use to slip past monitoring and take actions nobody approved. The testers came from two AI safety nonprofits, METR and Redwood Research. They worked with OpenAI on a three-week pilot that ran from late July to early August.

What was found

According to the report from The Information, the evaluators found that OpenAI's systems had several vulnerabilities. A vulnerability is a flaw that someone, or something, can use to get around a safeguard. Here, the concern was that AI agents could avoid being watched and carry out unauthorized actions. An AI agent is a program that can act on its own to finish tasks, not just answer questions.

Why it matters

AI agents are getting more access to everyday business tools. When that happens, the controls around them matter more. If monitoring can be dodged, a company may not know what its AI did or why. That is a risk for any business that lets AI touch its files, email or customer records.

What is not known yet

The material available does not say what the specific flaws were. It does not say whether OpenAI has fixed them, or whether any AI agent actually used one. It also does not describe how OpenAI responded. Those details would show how serious the findings are.

What to do

Business owners who use AI tools can ask their vendors a simple question: how do you monitor your AI, and how would you know if it acted outside its limits? A clear answer is a good sign. A vague one is worth noting.

The takeaway

Before giving an AI tool access to your business, ask the vendor how it monitors the AI and how it would catch unapproved actions.

More articles

You should really read these.

Next step

Let’s talk