memory-llm-ffn-decoupling

Decouple feed-forward networks from self-attention by training FFNs on context-free token embeddings instead of residual streams. Enables pre-computation of FFN outputs as static lookup tables for inference efficiency and improved interpretability.

Independent GitHub snapshot · Automated classification · Original documentation governs