#on-device AI
28 stories taggedon-device AI.
Running AI on Your Own Computer Is Getting Easier. Here Is What to Expect.
Privacy concerns are pushing more people toward local AI, software that runs entirely on your own machine instead of the cloud. The experience is genuinely promising and genuinely rough around the edges.
AI Agents Could Soon Tidy Up Their Own Memory Mid-Task
A new system from Apple ML Research lets an AI agent decide for itself when to compress its own working memory, stopping it from forgetting important details at the worst possible moment.
Liquid AI Releases Two Open-Weight Decision Models That Answer in Under 50 Milliseconds on Edge Hardware
The d1-3B and d1-omni-600M models skip word-by-word generation and return structured answers in a single calculation, fast enough to run on a $250 Jetson Orin Nano board.
Google's new EmbeddingGemma 2 crams search for text, images, audio and video onto a phone
The 740-million-parameter open model from Google DeepMind runs offline, under 600MB of RAM on a Pixel 11 Pro.
Apple Skipped Trump's White House AI Lunch. The Reason Is Simpler Than Twitter Thinks.
Every major AI company sent its CEO to Washington on Tuesday. Apple sent nobody. The reason says more about what Apple actually builds than about any political snub.
Apple Researchers Found a Smarter Way to Train Voice AI on Your Private Data Without Seeing It
A new technique from Apple ML Research could close the accuracy gap in speech recognition that learns from your device without your audio ever leaving it.
Apple quietly shrank the AI brain behind your iPhone's voice typing, and it matters more than you'd think
New research from Apple explains how it compressed a key piece of the always-on dictation system that lives entirely on your device, without wrecking accuracy or draining your battery.
Liquid AI's vision model gets a speed boost of up to 3.13 times with no change to what it says
A 280-million-parameter add-on lets LFM2.5-VL-3B generate text up to 3.13 times faster on Apple silicon, leaving output word-for-word identical.
Hugging Face Lets You Run Compressed AI Models on Your Mac With One Line of Code
Hugging Face has built GGUF support into its Transformers library, letting Apple Silicon Mac users load and run lightweight AI models at speeds matching dedicated local-AI apps, no special setup required.
Google says 300 languages, on-device translation, and a voice AI that runs over a phone call
The 86% figure is the headline. The more interesting engineering is aimed at the other billion.
Apple's Siri AI: Every New Thing It Can Do in iOS 27
Apple's long-struggling voice assistant gets a new name, a new app, and a serious upgrade. Here is what changes for iPhone owners, and which phones actually get the full package.
Apple's Health App Will Now Tell You Your 'Health Age' and How Ready Your Body Is Today
A revamped Apple Health app uses Apple's on-device AI to turn your watch and phone data into a single readiness score, a biological age estimate, and personalised coaching tips.
Perplexity's new hybrid AI keeps your sensitive files on your Mac while still using cloud intelligence
A built-in privacy filter decides in real time which parts of a task stay local and which go to the cloud. Lawyers, finance teams and healthcare workers are the target audience.
Nvidia's RTX Spark Chip Powers the First Wave of AI-Focused Laptops and Mini PCs
New machines from Lenovo, Acer, Asus and others promise enough power to run AI entirely on your own hardware, no internet connection required. Prices will be steep.
Hugging Face Releases 207 Speed-Boosted AI Building Blocks That Run Directly in Your Browser
A new open-source toolkit lets AI models run faster on your own device, without sending data to a server. Head-to-head tests on Apple M4 hardware show speeds more than double those of the current standard.