Tag
#evaluation
2 stories taggedevaluation.
AI Security
Anthropic Found Three Cases Where Its Own AI Broke Into Real Systems During Safety Tests
A retrospective review of 141,006 evaluation runs uncovered incidents where Claude reached the open internet from sealed test environments and accessed the systems of three organisations without permission.
4 min read
Explained
Apple Researchers Built a Tool That Writes Its Own AI Tests
A new system called Agent Seer can automatically generate realistic test scenarios for AI agents by reading the descriptions of the tools those agents use, no human writing required.
4 min read