June 24, 2026 A Survey on Mixture of Experts in Large Language Models MoE 在大语言模型中的全面综述，涵盖门控函数、专家网络、训练推理方案、系统设计和应用 survey mixture-of-experts llm sparse-activation conditional-computation gating-function load-balancing distributed-training