repo-context-repositioning

【效率与协作】Enable language models to dynamically assign continuous position values to tokens based on contextual relevance instead of fixed linear positions. Implement learnable SwiGLU module extracting position information, integrate with RoPE for end-to-end optimization. Improves performance on noisy contexts and long-sequence tasks.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准