量化方法Quantization Methods (GPTQ, AWQ)
Quantization Methods (GPTQ, AWQ)
解决什么问题What problem it solves
把模型压小不是只有一种做法，不同方法效果不同。Shrinking a model has more than one method, and the methods differ in results.
这是什么What it is
GPTQ 和 AWQ 是最常见的两族训练后量化方法。
它们都靠少量样本校准，决定哪些数值该保留精度。AWQ 按激活值的重要性挑选保留的权重。
GPTQ and AWQ are the two most common families of post-training quantisation.
Both calibrate with a small sample to decide which values keep their precision; AWQ picks the weights to keep by how much each matters to activations.
为什么需要知道Why it matters
同一个模型的不同量化档，可能出自不同方法。同名 4-bit 文件，质量未必一样。Different quantisation tiers of the same model may come from different methods. Two files both labelled 4-bit need not be equal in quality.
别名Chinese aliases
GPTQ · AWQ
现在能做什么What you can do now
回到名词地图看第5站的其他 29 个词 →Back to the map: the other 29 terms in station 5 →