1
Scaling Domain Data Repetition in LLM Pretraining
LLM预训练中领域数据重复的缩放规律,揭示数据重复如何影响模型性能与训练效率的边界效应。
arXiv:2608.14071v1 Announce Type: new Abstract: As large language models scale, their training-token budgets must also increase to maintain an appropr…