1
Stabilizing Native Low-Rank LLM Pretraining
低秩预训练大模型遭遇不稳定困境?这项ICML 2026研究提出原生低秩LLM预训练的稳定化方法,兼顾效率与质量。
arXiv:2602.12429v2 Announce Type: replace Abstract: Foundation models have achieved remarkable success, yet their growing parameter counts pose signif…