Tag
#quantization
2 stories taggedquantization.
Frontier Labs
Liquid AI Squeezes Its Small Models onto Phones and Raspberry Pis Without Losing Much Quality
A new training trick called Quantization-Aware Distillation lets Liquid AI's compact language models run on cheap hardware while keeping 97% of their full-precision accuracy.
3 min read
Explained
Run AI Image Models on a Normal GPU: Hugging Face Brings 4-Bit Diffusion to the Masses
A new integration called Nunchaku Lite lets image-generating AI run on consumer graphics cards with half the memory and roughly 30% faster speeds, no specialist setup required.
5 min read