hqq-quantization

【部署与运维】Half-Quadratic Quantization for LLMs without calibration data. Use when quantizing models to 4/3/2-bit precision without needing calibration datasets, for fast quantization workflows, or when deploying with vLLM or HuggingFace Transformers.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准