Tag
#llama.cpp
2 stories taggedllama.cpp.
Explained
Hugging Face Lets You Run Compressed AI Models on Your Mac With One Line of Code
Hugging Face has built GGUF support into its Transformers library, letting Apple Silicon Mac users load and run lightweight AI models at speeds matching dedicated local-AI apps, no special setup required.
4 min read
Frontier Labs
Liquid AI's New Draft Models Make Its LFMs Up to 3.2x Faster, No Quality Trade-off
A technique called speculative decoding lets a small helper model do the heavy lifting so the main model just checks the work. The result: dramatically faster output on everything from a data-centre GPU to a MacBook.
4 min read