1
LIBMoE: A Library for comprehensive benchmarking Mixture of Experts in Large Language Models
LIBMoE为LLM中的混合专家架构提供全面基准测试库，助力MoE研究标准化与可复现性。
arXiv:2411.00918v5 Announce Type: replace-cross Abstract: Mixture of experts (MoE) architectures have become a cornerstone for scaling up and are a ke…