探究数据混合与模型架构对非洲语言持续预训练的影响，为低资源语言建模提供前沿实证与设计指南。
arXiv:2601.06395v3 Announce Type: replace Abstract: Large language models (LLMs) are increasingly multilingual, yet open models continue to underperfo…
LLM继续预训练中，超参数配置可预测的缩放规律，告别启发式搜索与高昂成本
arXiv:2606.05610v1 Announce Type: new Abstract: The efficacy of continued pre-training for Large Language Models (LLMs) hinges upon hyperparameter con…
冻结深层、训练浅层，可解释的层分配策略让持续预训练更高效
arXiv:2605.11416v2 Announce Type: replace Abstract: Selective layer-wise updates are essential for low-cost continued pre-training of Large Language M…
揭示大模型英语偏见真相，证明持续预训练成本优势不存在，语言专用投资或成必然。
arXiv:2605.15613v1 Announce Type: new Abstract: Through an analysis of sequences generated by open-weight large language models (LLMs), we demonstrate…