Lex
@xw33bttv · 17. Feb. 2026
ruing technical terms here. Mixture of Experts (MoE) has literally nothing to do with what xAI actually shipped in 4.20.
This isn't one singular model, dense or MoE, with internal routing or sparse experts. It's four separate replicas (instanced) running at once in a quorum-st
Elon Musk
@elonmusk
Correct
18:59 · 17. Februar 2026 · 8291 Aufrufe
41
11
333