#inference
8 stories taggedinference.

NVIDIA's New Vera Rubin Chip Does 30 Times More AI Work Per Watt Than Its Predecessor
A new benchmark puts NVIDIA's Vera Rubin NVL72 hardware far ahead on energy efficiency for the kind of complex, multi-step AI tasks that companies are rapidly building into their products.

Nvidia's $20 Billion Groq Bet Goes Live: What It Means for AI Speed
Nvidia says its Groq 3 LPX racks are now in full production and will be online later this year, promising dramatically faster AI responses for everyday users.

An AI chip startup just tripled its valuation in six months. Here's who's paying and why.
Etched has raised $700 million at a $21 billion valuation, led by a Wall Street trading giant that actually tested the hardware first. The numbers are striking. The speed of the rise is even more so.

Groq raises $350 million after ditching its own chips for Nvidia's
Once an Nvidia rival, the startup is now an Nvidia customer. Here is what happened and what it means for the cloud companies racing to run your AI.

The AI Data Center That Fits in a Box: Inside Runware's Sonic Inference Pod
A startup wants to replace giant, water-hungry data centers with small, portable computing units that can be shipped anywhere there is a power socket. Here is what it is building, and whether it holds up.

Three Harvard Dropouts Just Raised $300 Million to Build the AI Chip That Rivals Keep Calling Impossible
Etched hit a $10.3 billion valuation in seven months by betting that specialised AI chips could beat general-purpose ones on speed and cost. Here is what that means for anyone who pays to run AI.

Microsoft plugs AMD's newest chips into Azure to handle the AI compute crunch
Three new virtual machine types land in Microsoft's cloud, each built around AMD's latest processors and aimed at a different piece of the AI workload puzzle.

The Electricity Problem at the Heart of Modern AI
Every AI data centre runs on a fixed power budget. The company that squeezes the most useful work out of each watt wins. Here is what that means in plain English.