derf-normalization-free-transformers

Replace LayerNorm with Derf(x) = erf(αx + s) for improved generalization in transformers. Derf outperforms LayerNorm across vision, speech, and DNA modeling—ideal when normalization-free training provides benefits without architectural complexity.

Independent GitHub snapshot · Automated classification · Original documentation governs