kv-cache-steering-reasoning

Guide frozen language models toward multi-step reasoning by modifying cached key-value representations after the prefilling stage. Extract steering vectors from contrastive prompt pairs and apply them to KV cache with scalar coefficients. Improves reasoning on GSM8K, ARC, CommonsenseQA while adding only 10ms overhead per token.

Independent GitHub snapshot · Automated classification · Original documentation governs