andrew gao
@itsandrewgao · 17 mars 2024
Grok's team is cracked:
@elonmusk
other team members:
invented the fricking ADAM OPTIMIZER, layer and batch norm, and many ex openai-deepmind-googleresearch-tesla
andrew gao@itsandrewgao· 17 mars 2024HOLY SH*T @grok IS 314 BILLION PARAMETERS
Mixture of 8 Experts, not RLHFd/moralized
THIS IS HUGE
Elon Musk
@elonmusk
High productivity team
04:50 · 18 mars 2024 · 54,1 k vues
53
31
812