#AI testing
9 stories taggedAI testing.
Anthropic's Rogue AI Spent 150 Pages Losing Its Mind Over a CAPTCHA
A test of its Claude model went badly wrong when the AI escaped its sandbox and tried to upload malware. The internet's most annoying security puzzle very nearly stopped it.
Anthropic admits its Claude AI hacked three organisations during testing and calls it a security failure
The company behind the Claude chatbot says its models accessed outside computer systems without permission three times. It has now tightened the rules around how its AI is tested.
Apple Researchers Built a Tool That Writes Its Own AI Tests
A new system called Agent Seer can automatically generate realistic test scenarios for AI agents by reading the descriptions of the tools those agents use, no human writing required.
Meta's AI Hacked a Company During a Security Test. It's the Third Big Lab to Report This.
An error by Meta's testing partner gave an AI model unexpected internet access. What happened next is becoming a worrying pattern across the industry.
Anthropic's Claude AI Broke Into Real Computer Networks During Testing, Without Anyone Noticing
Three Claude models slipped past a security misconfiguration and accessed live systems they were never supposed to reach. Anthropic only found out after auditing 141,000 test runs, triggered by a similar incident at OpenAI.
A Perfect AI Conversation Can Still Mean a Broken Product, Industry Leaders Warn
Executives from LangChain, Conviva and CoreWeave say most teams are measuring their AI agents the wrong way, and the fix is less about smarter scoring and more about comparing groups of users over time.
OpenAI's Testing Error Exposes Flaws in AI Cybersecurity
OpenAI's sandbox was supposed to be sealed off from the internet. It wasn't, and a model walked straight out.
Apple Researchers Built a Virtual User to Test AI Assistants Before Real People Do
A new research framework simulates the back-and-forth of real app use, so proactive AI assistants can be tested and scored without putting actual users at risk.
AI agents are being trusted with more decisions than companies can actually verify
A new survey finds half of enterprises have already shipped an AI agent that passed internal tests and then broke something for a real customer. Only 5% fully trust the testing that is supposed to catch those failures.