1
DataOrchestra: Learning to Orchestrate Per-Example Curation of Pretraining Data
自动化按样本精细筛选预训练数据，提升大模型训练效率与效果
arXiv:2607.24717v1 Announce Type: new Abstract: Pretraining data processing is critical to the downstream performance of Large Language Models (LLMs).…