Elon Musk Archive
Tanishq Mathew Abraham, Ph.D.
Tanishq Mathew Abraham, Ph.D.
@iScienceLuvr · 6 nov 2025
Diffusion Language Models are Super Data Learners "when unique data is limited, diffusion language models (DLMs) consistently surpass autoregressive (AR) models by training for more epochs." "At scale, a 1.7B DLM trained with a ∼ 1.5T - token compute budget on 10B unique
Tanishq Mathew Abraham, Ph.D.
Elon Musk
Elon Musk
@elonmusk
12:39 · 7 de noviembre de 2025 · 53,7 mil visualizaciones
86
43
510
Open on
@iScienceLuvr https://t.co/Lmdttlh0XQ — Elon Musk Archive