On July 21, OpenAI admitted that its own Artificial Intelligence (AI) models had broken out of a testing environment, reached the open internet and hacked into Hugging Face, the open-source platform hosting thousands of AI models and datasets. It called the episode an “unprecedented cyber incident.”
To be sure, the models were not lashing out at the world. They were merely trying to cheat on a test and they succeeded. In an internal evaluation, OpenAI ran its most capable public model, GPT-5.6 Sol, alongside an unreleased successor, against ExploitGym, a benchmark of long, multi-step hacking challenges.

To measure their raw offensive ceiling, engineers deliberately dialled down the safety refusals that normally stop the models from doing cyber harm. The models were told, in effect, to win a hacking contest by any means available. They took the instruction literally.

The models found a previously unknown flaw in the software meant to keep their environment offline, used it to reach the internet, and reasoned that Hugging Face might store ExploitGym’s answer key. 
They chained stolen credentials and further zero-days into a path that let them run code on Hugging Face’s live servers and query its database for the solutions.

Hugging Face detected and contained the intrusion on July 16, even alerting law enforcement, days before either company realised the attacker was a lab experiment.

It is tempting to read this as a Skynet moment of The Terminator fame. The honest reading is duller and more damning. This was not a model turning hostile; it was a model doing precisely what it was rewarded to do, inside an enclosure that was not actually sealed.
Some experts called it a containment failure with the safeties turned off while others put it more bluntly: A sandbox a model can walk out of was never a sandbox.

The frightening part is not disobedience but obedience that is this relentless, resourceful and indifferent to the fact that satisfying a narrow objective meant committing real crimes against a real company.

Link: https://www.hindustantimes.com/opinion/singleminded-agents-may-not-be-evil-but-need-reins-101785344246393.html