Lex
@xw33bttv · Feb 17, 2026
ruing technical terms here. Mixture of Experts (MoE) has literally nothing to do with what xAI actually shipped in 4.20.
This isn't one singular model, dense or MoE, with internal routing or sparse experts. It's four separate replicas (instanced) running at once in a quorum-st
Elon Musk
@elonmusk
Correct
06:59 PM · February 17, 2026 · 8.3K views
41
11
333