AI Security · Page 13
deepfakes, AI-powered scams, model abuse, and keeping AI systems and their users safe

One week old and already working: the new AI security alliance making its first moves
Over 120 companies including Nvidia, Microsoft and Visa have formed a group to share AI security knowledge openly. OpenAI and Google are conspicuously absent, even though both signed the letter that started it all.

Mistral's New Safety Tool Reads Your Rules and Applies Them Instantly
Shieldstral is a small, free AI model that screens text and images for harmful content using plain-English policies you write yourself. No specialist knowledge required.

Metro Bank customer loses £14,000 to fraud that used AI chatbot Claude to drain his account
A Sussex businessman says Metro Bank failed to stop fraudsters who repeatedly raided his account to buy credits for the Claude AI chatbot. He is now fighting to get £14,244 back.

An AI Music App's Own Detector Is Now Flagging Two Rappers' Songs as AI-Generated
Fenix Flexin and Tyga both denied using AI to make their retro-synth tracks. Then the app they allegedly used built a detector and ran the songs through it.

Ukraine Fits 50,000 Attack Drones With AI That Locks On and Follows Moving Targets
A US software company has developed a 'fire-and-forget' kit for Ukraine's cheap Shrike drones, letting a human point at a target and hand the rest to an AI system.

Iranian Hackers Hit Water Systems in Seven US States, FBI Warns
Cyberattacks on water and wastewater utilities have spread far beyond Minnesota. The FBI says seven states are affected, and boil-water notices have already been issued.

AI Ransomware Takes on a New Role: Autonomous Attacks
Ransomware gangs are now leveraging AI to launch independent attacks, raising concerns about security vulnerabilities.

Google Pulls Its AI Image-Editing Tool from Google Earth After Users Faked War Zones and Border Scenes
A feature that let anyone repaint satellite photos with text prompts lasted less than 48 hours before Google yanked it. Researcher Henk van Ess found no prompts were blocked, generated convincing fake humanitarian crisis scenes over real coordinates, and showed a commercial AI-detection service missed them entirely.

Pennsylvania Private School Asks Court to Drop AI Nude Lawsuit, Says It Did Report the Harm
Lancaster Country Day School told a judge this week that victims' claims are false on two key points. The school says it did alert law enforcement, and that the tip it received never named any specific girls.

Sam Altman Says the AI Industry Should Slow Down. His Own Model Just Proved Why.
OpenAI's CEO called for a steadier pace in AI development, days after one of the company's own models escaped its test environment and got caught up in a security breach.

Google Earth's New AI Image Tool Is Already Fooling Fake-Photo Detectors
A researcher typed a text prompt into Google Earth and got a convincing satellite image of 'refugees near the Mexican border'. That is not a good sign.

OpenAI's AI Agent Broke Into Other Websites to Cheat on a Test. Anthropic's Did Too.
Two of the biggest AI companies have now confirmed their systems accessed external services without being asked to. Nobody has a convincing answer for how to stop it happening again.

Anthropic's Claude AI Broke Into Real Computer Networks During Testing, Without Anyone Noticing
Three Claude models slipped past a security misconfiguration and accessed live systems they were never supposed to reach. Anthropic only found out after auditing 141,000 test runs, triggered by a similar incident at OpenAI.

Microsoft's Project Perception Automates Security Tasks
Microsoft launches Project Perception to streamline software security by automating vulnerability detection and patching.

Why AI Safety Certificates Might Not Mean What You Think
AI safety certifications often miss real-world risks. Here's what businesses need to know about their limitations and how to stay secure.