Elon Musk Archive
andrew gao
andrew gao
@itsandrewgao · 17 mar 2024
Grok's team is cracked: @elonmusk other team members: invented the fricking ADAM OPTIMIZER, layer and batch norm, and many ex openai-deepmind-googleresearch-tesla
andrew gaoandrew gao@itsandrewgao· 17 mar 2024
HOLY SH*T @grok IS 314 BILLION PARAMETERS Mixture of 8 Experts, not RLHFd/moralized THIS IS HUGE
andrew gao
Elon Musk
Elon Musk
@elonmusk
High productivity team
04:50 · 18 de marzo de 2024 · 54,1 mil visualizaciones
53
31
812
Open on
@itsandrewgao High productivity team — Elon Musk Archive