visor-sparse-vision-language-interaction

Optimize vision-language model inference by sparsifying the interactions between vision and language tokens instead of compressing images. Uses a dynamic policy to allocate visual computation per sample based on complexity, enabling a universal network across different compute budgets. Maintains high-resolution reasoning when needed. Use when deploying VLMs…

Independent GitHub snapshot · Automated classification · Original documentation governs