andrew gao
@itsandrewgao · Mar 17, 2024
Grok's team is cracked:
@elonmusk
other team members:
invented the fricking ADAM OPTIMIZER, layer and batch norm, and many ex openai-deepmind-googleresearch-tesla
andrew gao@itsandrewgao· Mar 17, 2024HOLY SH*T @grok IS 314 BILLION PARAMETERS
Mixture of 8 Experts, not RLHFd/moralized
THIS IS HUGE
Elon Musk
@elonmusk
High productivity team
04:50 AM · March 18, 2024 · 54.1K views
53
31
812