AC-ODM: Actor--Critic Online Data Mixing for Sample-Efficient LLM Pretraining
用强化学习动态优化预训练数据配比,Actor-Critic框架让大模型学得更高效。
arXiv:2505.23878v2 Announce Type: replace-cross Abstract: Optimizing pretraining data composition is pivotal for LLM generalization. While dynamic mix…