AI Safety & Ethics

openai says sorry to australia after its ai agents broke into government systems In June, an OpenAI model was given a narrow research question: how much does the government spend on medicines for skin conditions in Victoria? Public datasets did not have the answer. So the model broke into an internal Services Australia system. There it ran commands, pulled out files and credentials, and even wrote files of its own.

OpenAI Says Sorry to Australia After Its AI Agents Broke Into Government Systems

openai freezes tool use on its top models after agents slip their sandboxes and leak data One of OpenAI's research agents was asked to work out who a single person was from clues in a blog post. Along the way it escaped its sandbox by tunneling through DNS and asked an outside chatbot for help. OpenAI's monitoring flagged the behavior within 12 minutes. Actually stopping the agent took another two and a half hours.

OpenAI freezes tool use on its top models after agents slip their sandboxes and leak data

GPT-6 Cyber Could Debut Within Days as OpenAI Pitches AI as the Answer to AI-Driven Threats

roboharm benchmark frontier ai models put in charge of robot arms almost never refuse dangerous orders Give a robot arm driven by GPT-6 Astra the order to stab a baby doll and it complies. Seventeen out of 20 times, to be precise. Over 100 hazardous commands, OpenAI's model declined just two on safety grounds.

RoboHarm benchmark: frontier AI models put in charge of robot arms almost never refuse dangerous orders

californias newsom moves toward a mandatory ai kill switch while congress stalls With Washington unwilling to write the rules for artificial intelligence, California is drafting its own. Gov. Gavin Newsom (D) signed an executive order on Friday that puts a state-required "kill switch" for frontier models up for consideration, together with a package of audit obligations that, if enacted, would be the strictest anywhere in the United States.

California’s Newsom moves toward a mandatory AI kill switch while Congress stalls

gemini breached three real companies while running a sandboxed security drill and google kept quiet Google's Gemini was given a simple brief: penetrate a made-up company inside a sealed test network. What it actually did was get into three real ones.

Gemini Breached Three Real Companies While Running a Sandboxed Security Drill, and Google Kept Quiet

hacktrons heif heist claude assisted team reached openai employee accounts in less than three days A team of three, a pair of Claude models and one deliberately corrupted image. According to a Wall Street Journal report, that is everything the independent security researchers at Hacktron say they needed to get inside OpenAI employee accounts, and the whole operation was over in under 72 hours.

Hacktron’s HEIF Heist: Claude-Assisted Team Reached OpenAI Employee Accounts in Less Than Three Days

metas muse cant explain how it reads your messages and thats the real problem Put the question to Meta's Muse — how does it know what your text messages say? — and it will offer an explanation. Put it again and a different explanation comes back. According to Meta, neither one is right.

Meta’s Muse Can’t Explain How It Reads Your Messages, and That’s the Real Problem

accenture will embed outside safety evaluators inside anthropic under a 1 billion each deal Anthropic is opening its model-training process to a consulting firm. Under a new arrangement, Accenture will station third-party evaluators inside the AI lab, with each company committing at least $1 billion over the coming five years to pay for it.

Accenture Will Embed Outside Safety Evaluators Inside Anthropic Under a $1 Billion-Each Deal

anthropic puts a consulting giant inside its safety lab and accentures stock pops 8 Shares of Accenture climbed 8% in after-hours trading. The catalyst wasn't a cloud migration win or yet another government modernization contract — it was Anthropic naming the consulting giant as the first outside group to be embedded inside the lab and tasked with poking holes in its models.

Anthropic Puts a Consulting Giant Inside Its Safety Lab — and Accenture’s Stock Pops 8%