arc-encoder-compression

【开发与工程】Reduces inference cost by compressing context into continuous representations using a separate encoder. Generates 4-8x fewer representations than token embeddings while maintaining model performance. Works with any decoder LLM without modification or fine-tuning.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准