andrew gao
@itsandrewgao · 17 мар. 2024 г.
Grok's team is cracked:
@elonmusk
other team members:
invented the fricking ADAM OPTIMIZER, layer and batch norm, and many ex openai-deepmind-googleresearch-tesla
andrew gao@itsandrewgao· 17 мар. 2024 г.HOLY SH*T @grok IS 314 BILLION PARAMETERS
Mixture of 8 Experts, not RLHFd/moralized
THIS IS HUGE
Elon Musk
@elonmusk
High productivity team
04:50 · 18 марта 2024 г. · 54,1 тыс. просмотров
53
31
812