flash-prefill

【效率与协作】Accelerates long-context LLM prefilling by identifying sparse attention patterns without expensive scoring, using block-level approximations and dynamic thresholding. Achieves 27.78x speedup at 256K tokens while maintaining accuracy.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准