Leandro's thread: https://t.co/6oAw6ZgUuV
Thomas Wolf(@Thom_Wolf) · 人工智能
Leandro's thread: x.com/lvwerra/status… Leandro von Werra @lvwerra After the Ultra Scale Playbook, Nouamane is back with this crazy guide to train MoEs! It's probably the most comprehensive resource if you want to get into large scale MoE training and an absolute gem packed with beautiful visualization! 🔗 View Quoted Tweet 💬 0 🔄 0 ❤️ 3 👀 675 📊 1 ⚡ Powered by xgo.ing