Efficient Mixture of Expert Networks Meta Awesome-Mixture-of-Experts-Papers Papers and Systems FastMoE: paper, code, webpage FasterMoE: modeling and optimizing training of large-scale dynamic pre-trained models Optimizing Mixture of Experts using Dynamic Recompilations