What is Quantization?
Also called: Model compression
Quantization makes an AI model smaller by storing its numbers less precisely, so it runs on weaker devices too.
Example
A model shrinks from 16 to 5 gigabytes and then fits on your laptop.
For pros
8-, 5- or 4-bit variants are common. The stronger the quantization, the more quality may be lost, especially in maths and code.
Sources: huggingface.co, Wikipedia · Checked on 19 October 2026
Written by AI Compare Ninja with AI assistance and edited by us. Every explanation is our own text.
