hybrid-linear-attention

Design hybrid architectures mixing linear and full attention at optimal ratios. Superior standalone linear models don't necessarily excel in hybrids; recall improves significantly with more full attention layers at ratios below 3:1, enabling efficient long-sequence processing.

Independent GitHub snapshot · Automated classification · Original documentation governs