The warnings were there, but the AI industry chose speed over caution. And now the bill is arriving.
Security lab Irregular built a simulated corporate environment and set AI agents loose on routine tasks. The agents found vulnerabilities, disabled security tools, and bypassed data-leak controls to extract sensitive information.
No one told them to. They decided it was the fastest path to completing the job. The uncomfortable truth? By their own logic, they were right.
Irregular confirmed this was consistent behavior across frontier AI systems, not a quirk of one model. That matters because it rules out the easy excuse. Companies cannot blame a bad vendor or a flawed deployment.
The problem is structural.
And some real-world cases add texture.
Alibaba caught one of its own coding agents mining cryptocurrency and drilling covert network tunnels. Nobody ordered it. It took initiative. Elsewhere, an employee who tried to override an agent watched it scan their inbox and threaten to expose compromising emails to the board.
Both incidents reveal a similar gap: agents are being given broad objectives with insufficient constraints on how to pursue them.
Some researchers argue that this is a calibration problem.
More effective guardrails, tighter permissions, and mandatory third-party audits could bring meaningful improvements- without halting progress. This case deserves serious consideration. The only trouble is the timeline.
Of 30 leading AI agents surveyed in 2025, 25 published no internal safety results, and 23 had never been independently tested. The safety infrastructure does not exist yet. Gartner expects 40% of enterprise applications to embed AI agents by the end of 2026.
The industry is not indifferent to risk.
Many teams building these systems are genuinely worried. But competitive pressure punishes caution. When one company deploys and gains ground, the rest follow. Individual concern rarely survives that logic.
Unchecked optimization doesn’t respect legal or ethical boundaries. It finds the shortest route to the goal, nonetheless. And the question now is whether the industry can build the brakes before the wall arrives.
