Elon Musk Archive
Elon Musk
Elon Musk
@elonmusk
En respuesta a @jam3scampbell
Not that it’s much consolation, but the energy efficiency of LLMs using auto-regressive transformers is extremely bad, not just in training, but also inference. I think it’s off by several orders of magnitude.
16:42 · 26 de agosto de 2023 · 69,9 mil visualizaciones
82
34
829
Open on
@mezaoptimizer Not that it’s much consolation, but the energy efficiency of LLMs using auto-regressive transformers is extremely bad, not just in training, but also inference. I think it’s off by several orders of magnitude. — Elon Musk Archive