Andrej Karpathy
@karpathy · Mar 9, 2026
Three days ago I left autoresearch tuning nanochat for ~2 days on depth=12 model. It found ~20 changes that improved the validation loss. I tested these changes yesterday and all of them were additive and transferred to larger (depth=24) models. Stacking up all of these changes,
Elon Musk
@elonmusk
We are in the Singularity
11:55 PM · March 9, 2026 · 682.3K views
884
833
8.2K