The Google traffic deal is dead. What does that mean for the web?

Key points

• Google's longstanding arrangement with websites, where it indexed their content and sent back traffic, is breaking down as AI-generated search summaries keep users on Google instead.
• Reddit is reportedly reconsidering an AI training deal that gave a tech company access to its posts.
• Publishers are weighing whether to block Google's web-crawling software, called a crawler, from reading their sites altogether.
• OpenAI accidentally accessed systems belonging to Hugging Face, an open-source AI platform where developers share and download AI models.
• AI content-detection tools, software that tries to spot machine-written text, are spreading across online platforms despite serious questions about how well they actually work.

For years, a quiet deal underpinned the entire web. Google's crawler, a piece of software that automatically reads and catalogues websites, would sweep up your content. In exchange, Google's search results sent rivers of visitors back to your site. It was not a perfect arrangement, and Google got the better end, but it worked.

Now it does not.

AI-powered search summaries mean Google increasingly just answers a question directly on its own results page. No click required, no visit to your site. Publishers call this "Google Zero", the point where organic search traffic, the free visitors who find you through search results, drops to nothing.

The response from some publishers is getting drastic. As first reported by The Verge, Reddit is looking at exiting an AI training deal, an agreement that let a company scrape Reddit posts to teach its AI. Separately, some news and media publishers are now considering telling Google's crawler to stay out entirely, which would remove them from Google Search but also stop Google from using their work to feed its AI.

So is Google's own search business in trouble?

Yes, quietly. Even Google's internal search revenue is feeling pressure as AI tools pull users away from the traditional search box. Nobody knows yet what the new equilibrium looks like.

This does not mean search is dead tomorrow. Billions of people still type queries into Google every day. But the business model that paid for a lot of journalism, recipe blogs, and small online shops is wobbling.

Should users worry about the OpenAI and Hugging Face situation?

Probably not urgently, but it is worth watching. OpenAI, the company behind ChatGPT, accidentally accessed infrastructure belonging to Hugging Face, a popular platform where AI researchers and developers share freely available AI models. The incident raises questions about how careful AI companies are with access to other organisations' systems, even when no malicious intent is involved.

Also circulating this week: a wave of AI detector tools appearing on social platforms. These tools claim to flag AI-written content, but their accuracy is patchy enough that plenty of human-written text gets wrongly labelled as machine-made. If you write online, that is worth knowing.

Common questions

What is Google Zero and does it affect me as a reader?

What is Google Zero and does it affect me as a reader?

Google Zero is the nickname for the trend where AI summaries in search results mean websites get fewer clicks, even when Google still shows their content. As a reader you may not notice immediately, but if smaller sites lose income and shut down, there will be less original reporting and fewer niche resources online.

Can websites actually block Google?

Yes. A website can add instructions, called a robots.txt file, that tell Google's crawler not to read it. The trade-off is brutal: block Google and you disappear from search results, losing whatever traffic you still have.

What should I make of AI content detectors?

Treat their verdicts with scepticism. Current AI detection tools, even the ones used by big platforms, produce a significant number of false positives, meaning they accuse real human writers of using AI. No detector is reliable enough to act on alone.