Andrej Karpathy
@karpathy · May 11, 2025
We're missing (at least one) major paradigm for LLM learning. Not sure what to call it, possibly it has a name - system prompt learning?
Pretraining is for knowledge.
Finetuning (SL/RL) is for habitual behavior.
Both of these involve a change in parameters but a lot of human
Elon Musk
@elonmusk
Noted
04:34 AM · May 11, 2025 · 41.1K views
33
30
757