andrew gao
@itsandrewgao · 17. März 2024
Grok's team is cracked:
@elonmusk
other team members:
invented the fricking ADAM OPTIMIZER, layer and batch norm, and many ex openai-deepmind-googleresearch-tesla
andrew gao@itsandrewgao· 17. März 2024HOLY SH*T @grok IS 314 BILLION PARAMETERS
Mixture of 8 Experts, not RLHFd/moralized
THIS IS HUGE
Elon Musk
@elonmusk
High productivity team
04:50 · 18. März 2024 · 54.132 Aufrufe
53
31
812