1
Spokes: Optimizing for Diverse Pretraining Data Selection
这篇论文提出Spokes方法，通过多样性优化策略提升预训练数据选择效果，为AI大模型训练提供新思路。
arXiv:2606.15216v1 Announce Type: cross Abstract: Diversity plays a critical role in data selection, improving performance under fixed data budgets by…