arc-encoder-compression

Reduces inference cost by compressing context into continuous representations using a separate encoder. Generates 4-8x fewer representations than token embeddings while maintaining model performance. Works with any decoder LLM without modification or fine-tuning.

Independent GitHub snapshot · Automated classification · Original documentation governs