
Andrej Karpathy
@karpathy · 18 juil. 2024
LLM model size competition is intensifying… backwards!
My bet is that we'll see models that "think" very well and reliably that are very very small. There is most likely a setting even of GPT-2 parameters for which most people will consider GPT-2 "smart". The reason current
Artificial Analysis@ArtificialAnlys· 18 juil. 2024GPT-4o Mini, announced today, is very impressive for how cheap it is being offered 👀
With a MMLU score of 82% (reported by TechCrunch), it surpasses the quality of other smaller models including Gemini 1.5 Flash (79%) and Claude 3 Haiku (75%). What is particularly exciting is

Elon Musk
@elonmusk
Yup, same thing happening with real-world AI at Tesla
21:56 · 18 juillet 2024 · 164,3 k vues
57
107
2,5 k