poet-orthogonal-llm-training

Improve LLM training stability and generalization by reparameterizing weight matrices as orthogonal transformations, achieving better perplexity than AdamW with fewer trainable parameters.

Independent GitHub snapshot · Automated classification · Original documentation governs