The Ultimate MoE Training Handbook
Hugging Face's free interactive technical handbook covers mixture-of-experts training, hardware setup, expert routing, load balancing, distributed training and serving. Intended for readers with machine-learning engineering experience.
