Whole Mars Catalog

@wholemars · Jun 4, 2024

thanks for the color. very interesting. off topic, but how do you see Dojo comparing to the Nvidia cluster? Is there a realistic pathway to one day producing training compute internally rather than buying from Nvidia?

Elon Musk

@elonmusk

Training compute for Tesla is relatively small compared to inference compute, as the latter scales linearly with size of fleet. Perhaps the best way to think about it is in terms of power consumption. When the Tesla fleet reaches 100M vehicles, peak power consumption of AI hardware in cars will be ~100GW. Training power consumption is probably <5GW. These are very rough guesses. Obviously, 5GW of AI training compute is enormous by current standards, but is only about 5% of total Tesla AI compute. There is a path for Dojo to exceed Nvidia. It is a long shot, as I’ve said before, but success is one of the possible outcomes.

06:50 PM · June 4, 2024 · 607.9K views

224

466

X →