Google DeepMind's Boss Wants a U.S. Government-Backed Body to Vet AI Before It Ships

Key points

• Google DeepMind CEO Demis Hassabis published a proposal on Tuesday calling for a U.S.-led, federally overseen body to review AI models before public release.
• Hassabis warned that frontier AI models already pose cybersecurity risks and could soon enable nuclear or biological threats.
• The proposed body would require AI companies to submit new models for review up to 30 days before launch, starting voluntarily, then becoming mandatory.
• Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman have each made similar calls for an AI oversight body in recent weeks.
• Funding for the watchdog would "likely" come from the AI industry itself, Hassabis said.

Demis Hassabis, the CEO of Google DeepMind and a 2024 Nobel laureate in chemistry, posted a detailed proposal on Tuesday for a new American institution that would test powerful AI models before they reach the public. Think of it as the Food and Drug Administration, but for AI software.

Hassabis said the body should be modelled on FINRA, the Financial Industry Regulatory Authority, which licenses and polices brokerage firms and exchange markets in the United States. FINRA is federally overseen but structured as a public-private partnership, with government and industry sharing governance.

The urgency, in his own words: "We've already seen the challenges frontier models pose for cybersecurity, and other threats including nuclear and bio risks may soon emerge as capabilities continue to advance."

His proposal says AI companies would voluntarily submit new models for review up to 30 days before launch. Once the body proves effective, that submission would become mandatory for any model sold in the U.S. Market.

The testing would examine whether a model can be tricked into bypassing its own safety rules, whether it shows signs of deception, and whether its outputs can be watermarked or traced to an AI source. That last point has a practical edge for ordinary users: it is how employers, banks or medical offices would eventually verify whether a document was written by a person or generated by software.

Money is the obvious question. Hassabis said the body would need "substantial" funding to hire top technical staff and run computing infrastructure for large-scale testing. He expects the AI industry to pay for most of it.

This is not a lone voice. Hassabis and Anthropic CEO Dario Amodei raised the idea at a G7 meeting that included President Donald Trump last month, as first reported by CNBC Tech. OpenAI CEO Sam Altman published a similar argument in the Financial Times earlier this month. We covered Anthropic's parallel push for stricter regulation in our 16 July story on the company's motives.

Yet the political path is bumpy. The Trump administration recently imposed temporary export controls on an advanced Anthropic model, then asked OpenAI to slow the rollout of a new one. Hassabis is essentially asking the same government that is already restricting AI to build a formal, funded, staffed institution around it.

What does this mean for people who use AI at work?

If this body is ever created, models you use through work software or consumer apps would have to pass a safety review before launch. That could mean slightly slower release schedules, but it also means an independent check on whether a tool can be manipulated into producing dangerous output. For most users the practical effect would be invisible, unless it quietly prevents the next major security incident involving an AI product.

The U.S.-China dimension adds pressure. Chinese AI models from companies including DeepSeek are winning customers among American businesses, partly on cost. U.S. Lawmakers are now considering restrictions on their adoption, with the State Department telling CNBC it raises "serious concerns." A domestic standards body would almost certainly apply to foreign models sold in the U.S. Market too.

Honest takeaway: Consensus among tech CEOs is not the same as political momentum. Watch whether Congress picks this up, not whether more executives add their names to the list.