memory-llm-ffn-decoupling

【效率与协作】Decouple feed-forward networks from self-attention by training FFNs on context-free token embeddings instead of residual streams. Enables pre-computation of FFN outputs as static lookup tables for inference efficiency and improved interpretability.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准