derf-normalization-free-transformers

【效率与协作】Replace LayerNorm with Derf(x) = erf(αx + s) for improved generalization in transformers. Derf outperforms LayerNorm across vision, speech, and DNA modeling—ideal when normalization-free training provides benefits without architectural complexity.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准