ALEX
@ajtourville · Jun 5, 2024
Ross Gerber is not very bright. There's absolutely nothing weird about Elon Musk saying Tesla did not have the room at Giga Texas to install 12,000 Nvidia H100 GPUs.
Anyone who has remotely followed the construction of Giga Texas knows every section of the factory is built to
Elon Musk
@elonmusk
The existing factory space was already allocated to vehicle, battery and cell production.
And this is not a matter of tucking a few computers into a corner. You need a kW of power and cooling for each GPU, which would mean 12MW of power and 12MW of cooling.
The south extension is custom-built for heavy power compute and cooling (the cooling towers are huge). Initial system is 50k H100s, plus 20k Tesla HW4 AI computers and massive video storage.
Important to note that FSD training requires massive liquid-cooled Tesla AI compute and video storage, not just Nvidia.
02:22 PM · June 5, 2024 · 435.2K views
295
450
3.9K