1
PR2: Predictive Routing Replay for MoE-Based LLM Reinforcement Learning
用预测性路由重放技术优化MoE大模型强化学习,显著提升训练效率与模型性能
arXiv:2606.00395v1 Announce Type: new Abstract: Mixture of Experts (MoE) Large Language Models (LLMs) achieve strong performance at scale. However, re…