Transformer co-author who scaled mixture-of-experts to enormous models
A co-author of “Attention Is All You Need”, co-founder of Character.AI and now a lead on Google’s Gemini. His 2017 work revived mixture-of-experts at very large scale.
Nothing of theirs is filed in the hub yet. Browse the full library.