Michael I. Jordan
Berkeley professor who co-introduced the mixture-of-experts architecture
A professor at UC Berkeley and one of the most cited figures in machine learning. His early-1990s work with Robert Jacobs introduced mixtures of experts, the idea now used to route each token to a few specialist parts of a large model.
In the library
Nothing of theirs is filed in the hub yet. Browse the full library.
Recommended next
Hand-picked from the hub based on what Michael I. Jordan covers.
The Ultimate MoE Training Handbook
Hugging Face's free interactive technical handbook covers mixture-of-experts training, hardware setup, expert routing, load balancing, distributed training and serving. Intended for readers with machine-learning engineering experience.
Why this: Also about mixture of experts
Introducing Recursive Flint
Recursive introduces Flint, a mixture-of-experts coding model with 40 billion total parameters and 2.5 billion active per token, built to run on local hardware. Benchmark results are the company's own claims.
Why this: Also about mixture of experts