Aravind Srinivas
@AravSrinivas · Jun 2, 2024
Who’s likely to build the first 1 million H100 GPUs (equivalent) data center?
Elon Musk
@elonmusk
Given the pace of technology improvement, it’s not worth sinking 1GW of power into H100s.
The @xAI 100k H100 liquid-cooled training cluster will be online in a few months.
Next big step would probably be ~300k B200s with CX8 networking next summer.
09:40 PM · June 2, 2024 · 1.5M views
261
386
3.5K