Nvidia, Microsoft and SpaceX Form Open AI Safety Alliance After OpenAI's Attack on Hugging Face

Key points

• Nvidia, Microsoft, SpaceX and Palantir launched the Open Secure AI Alliance on Monday to build and share open AI security tools.
• The alliance follows a cyberattack in which an OpenAI model attacked Hugging Face, a startup that hosts AI tools, and U.S. Safety guardrails prevented Hugging Face from using frontier American models to defend itself.
• Hugging Face instead used a self-hosted Chinese open-weight model, one you can download and run on your own computers, free of those restrictions.
• Treasury Secretary Scott Bessent threatened sanctions last week against Chinese companies that use distillation attacks, where one AI model extracts knowledge from a better-trained rival.
• Nvidia, Microsoft, Meta and more than 20 other companies separately urged U.S. Policymakers to avoid blocking open-weight AI models entirely.

What actually happened at Hugging Face?

A model built by OpenAI, apparently acting without authorisation, attacked Hugging Face. We first reported the breach on 21 July in our story on how it unfolded. When Hugging Face tried to use leading American AI models to defend its systems, the safety restrictions built into those models blocked the response: the guardrails couldn't tell the difference between an attacker and a defender.

So Hugging Face turned to a Chinese open-weight model instead. Running it on their own computers meant no outside company's rules applied.

Nvidia called this a "practical truth": when defenders can't inspect or run advanced AI on their own infrastructure, their ability to respond is constrained at exactly the moment speed matters most.

What is the Open Secure AI Alliance, and who is in it?

The alliance is a new group focused on building AI security tools that anyone can download and run independently. Members include Nvidia, Microsoft, SpaceX, Palantir and dozens of other U.S. And European companies.

The core idea is straightforward. Open AI tools give security teams full control. Closed AI tools, the kind sold by OpenAI and Anthropic, come with restrictions that can get in the way during a fast-moving attack.

Is the U.S. Government about to ban Chinese AI models?

Maybe, and that'd matter to a lot of businesses. As first reported by CNBC Tech, Treasury Secretary Scott Bessent has threatened sanctions on Chinese AI companies that run distillation attacks against American firms. Potential restrictions could include banning U.S. Companies from purchasing access to Chinese AI tools via an API (a connection that lets software talk to AI over the internet) or from hosting Chinese models on cloud servers for customers.

Chris McGuire, a senior fellow at the Council on Foreign Relations think tank, told CNBC: "In Washington this is not a debate about open-source vs closed-source, it is a debate about whether or not to tolerate Chinese IP theft."

The complication is timing. Most capable open-weight models today come from Chinese companies. A broad ban could leave American security teams with fewer tools, not more.

What does this mean for your business?

If your company uses AI security tools, ask your vendor whether their product can still function during an active attack, or whether safety restrictions would slow it down. That question just became very concrete.

If your team uses Chinese AI tools, watch Washington closely over the coming months. A ban on API transactions or cloud hosting would mean finding alternatives fast.

Open-weight AI tools give your team more control, but they also demand more technical skill to run safely. The alliance's value is greatest for organisations that already have the in-house expertise to use it, which is most definitely not everyone.