#on-device AI
15 stories taggedon-device AI.
Apple researchers found a smarter way to build smaller AI models, and it could cut your phone's battery drain
A new technique called IDEA Prune trains a big AI model first, then trims it down. The result is a leaner model that outperforms ones built small from the start.
A 27-billion-parameter AI model you can run at home just matched cloud-only rivals on coding tests
Alibaba's Qwen3.8-27B is free to download, fits on a high-end laptop, and scored level with mid-tier OpenAI and Anthropic models on independent benchmarks. Developers are calling it the clearest sign yet that frontier-grade AI is moving off the cloud and onto personal hardware.
Liquid AI's New Draft Models Make Its LFMs Up to 3.2x Faster, No Quality Trade-off
A technique called speculative decoding lets a small helper model do the heavy lifting so the main model just checks the work. The result: dramatically faster output on everything from a data-centre GPU to a MacBook.
Liquid AI Squeezes Its Small Models onto Phones and Raspberry Pis Without Losing Much Quality
A new training trick called Quantization-Aware Distillation lets Liquid AI's compact language models run on cheap hardware while keeping 97% of their full-precision accuracy.
Liquid AI's LFM2.5-VL-3B Can Run on Your Phone and Still Read Your Screen
The new 3-billion-parameter vision model fits in 3 GB of memory, beats larger rivals on screen-reading benchmarks, and runs fast enough on a smartphone to be genuinely useful.
Meta releases Glimmer AI model that runs privately on your own computer
The new 30-billion parameter model can manage your schedule, files and messages without sending data to the cloud. But Meta's most powerful AI stays firmly under its own control.
Meta's Muse Glimmer Is a 30-Billion-Parameter AI You Can Run on Your Own Machine
The new open-source model sees images, understands video, and can act as a personal assistant, all without sending your data to a cloud server.
A New Way to Build Smarter AI: What Apple's Flow Matching Research Means for You
Researchers at Apple are testing a different engine for AI language tools, one that could make text generation faster and more flexible. Here is what it is and why it matters.
MacPaw teams up with Liquid AI to run its assistant directly on your Mac
The company behind SetApp wants its AI tools to work offline, keep your data on your device, and eventually let developers plug into the same system.
Liquid AI's new 2.6B model runs AI agents directly on your laptop or phone
LFM2.5-2.6B is a compact AI model that can handle multi-step tasks without sending your data to the cloud, and it competes with models four times its size on key benchmarks.
Apple's Tim Cook calls on-device AI a 'competitive weapon' as rivals pour billions into data centres
On his last earnings call as CEO, Cook argued that running AI directly on iPhones and Macs gives Apple an edge that no amount of cloud spending can easily copy.
Apple's New On-Device AI Voice Tech Makes Siri Sound More Human, Without Sending Your Audio to the Cloud
A research paper from Apple's machine learning team reveals the audio engine behind Siri's more expressive new voices. All the processing happens on your iPhone, using a chip you already have.
Apple Is Talking to the Startup That Squeezes Giant AI Into an iPhone
PrismML says it shrunk a 54-gigabyte AI model down to under 4 gigabytes. Apple is paying close attention.
Apple's New Siri AI Arrives in Public Beta: What It Can Actually Do
iOS 27 brings a rebuilt Siri that reads your screen, digs through your texts, and lives inside every corner of your iPhone. We spent time with it. Here is what you get.
Apple's Abandoned Self-Driving Car Quietly Built the AI Chip Inside Every iPhone
A cancelled car project from years ago turns out to be the origin story of Apple's most important piece of AI hardware.