Andrej Karpathy
@karpathy · 11 mai 2025
We're missing (at least one) major paradigm for LLM learning. Not sure what to call it, possibly it has a name - system prompt learning?
Pretraining is for knowledge.
Finetuning (SL/RL) is for habitual behavior.
Both of these involve a change in parameters but a lot of human
Elon Musk
@elonmusk
Noted
04:34 · 11 mai 2025 · 41,1 k vues
33
30
757