#language models
22 stories taggedlanguage models.

Falcon-Emirati-7B Can Actually Speak Emirati Arabic, Not Just Translate It
The Technology Innovation Institute has released a 7-billion-parameter model trained specifically on the Emirati dialect, scoring 84.83% on a purpose-built benchmark where models far larger fall short.

A Tiny Open-Source AI Can Write a Research Report in 51 Seconds. Scientists Can Run It at Home.
Hugging Face and the Allen Institute for AI have released AstaBrief 8B, a small, open model that generates cited scientific reports faster than the big proprietary systems, and lets researchers keep sensitive unpublished work off third-party servers.

Apple Researchers Taught an AI to Learn From Its Own Failures by Writing Itself a One-Line Memo
A new technique called RLTL;DR lets an AI model summarise why it failed, then carry that lesson into its next attempt. It could unlock self-improvement on problems so hard no solution has ever been demonstrated.

When AI talks to AI, how much meaning survives the journey?
New research from Apple ML Research ran a controlled test to see how well language models pass precise information through plain words. The results expose a gap that matters for anyone building AI systems that need to work together.

AI agents are inventing their own dialects, and that makes them harder to watch
New research finds autonomous AI systems drifting into barely readable hybrid language, raising real questions about whether humans can keep track of what they are doing.

Apple researchers say bad training paths, not weak models, are why fast AI text generation keeps failing
Apple ML Research argues the flaw in distilled text generators sits in the routes a teacher model records, before the student ever sees them.

Can an AI learn your taste? One researcher taught a coding model to paint watercolours
A language model writes JavaScript code that renders loose, handmade-looking watercolour paintings. The results went viral. Now the full training recipe is open for anyone to run.

Apple researchers found a smarter way to build smaller AI models, and it could cut your phone's battery drain
A new technique called IDEA Prune trains a big AI model first, then trims it down. The result is a leaner model that outperforms ones built small from the start.

Apple's AI Model Can Write Text and Draw Pictures at the Same Time, Using One Engine
A new research model from Apple blends language and image generation into a single, unified system. Here is why that matters for the next generation of AI assistants.

Children learn language on a fraction of the data AI needs. Scientists want to know why.
A toddler masters grammar after hearing roughly 10 million words. A large language model may consume 15 trillion. Closing that gap could reshape how AI is built.

Apple AI Research Finds a Cheap Way to Teach AI More Languages
A new technique from Apple ML Research helps AI understand low-resource languages without needing mountains of translated text, and it could matter for hundreds of millions of people whose languages get left behind.

Apple's AI Lab Ran 2,000 Training Experiments to Crack a Problem Every AI Builder Faces
How do you teach an AI model about a rare language or niche subject when there is barely any text to learn from? Apple ML Research spent thousands of runs finding out.

More Memory Does Not Always Mean a Smarter AI Agent
A study across eight AI models found that feeding an agent more of its own past experience can hurt as much as help. The right amount of memory depends entirely on how capable the model already is.

AI That Thinks in Your Language: Big Study Shows Non-English Reasoning Nearly Matches English
Researchers trained AI reasoning models in French, Arabic, Chinese and more, and the results were surprisingly close to English. Here's what that means for the billions of people who don't use AI in their first language.

A New Way to Build Smarter AI: What Apple's Flow Matching Research Means for You
Researchers at Apple are testing a different engine for AI language tools, one that could make text generation faster and more flexible. Here is what it is and why it matters.