gguf-quantization

【部署与运维】GGUF format and llama.cpp quantization for efficient CPU/GPU inference. Use when deploying models on consumer hardware, Apple Silicon, or when needing flexible quantization from 2-8 bit without GPU requirements.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准