Lex
@xw33bttv · 17 févr. 2026
ruing technical terms here. Mixture of Experts (MoE) has literally nothing to do with what xAI actually shipped in 4.20.
This isn't one singular model, dense or MoE, with internal routing or sparse experts. It's four separate replicas (instanced) running at once in a quorum-st
Elon Musk
@elonmusk
Correct
18:59 · 17 février 2026 · 8,3 k vues
41
11
333