Andrej Karpathy

@karpathy · 27 janv. 2025

I don't have too too much to add on top of this earlier post on V3 and I think it applies to R1 too (which is the more recent, thinking equivalent). I will say that Deep Learning has a legendary ravenous appetite for compute, like no other algorithm that has ever been developed

Andrej Karpathy@karpathy· 26 déc. 2024

DeepSeek (Chinese AI co) making it look easy today with an open weights release of a frontier-grade LLM trained on a joke of a budget (2048 GPUs for 2 months, $6M). For reference, this level of capability is supposed to require clusters of closer to 16K GPUs, the ones being

Elon Musk

@elonmusk

🎯

18:22 · 28 janvier 2025 · 57,8 k vues

953

X →