Andrej Karpathy
@karpathy · Jul 18, 2024
LLM model size competition is intensifying… backwards!
My bet is that we'll see models that "think" very well and reliably that are very very small. There is most likely a setting even of GPT-2 parameters for which most people will consider GPT-2 "smart". The reason current
Artificial Analysis@ArtificialAnlys· Jul 18, 2024GPT-4o Mini, announced today, is very impressive for how cheap it is being offered 👀
With a MMLU score of 82% (reported by TechCrunch), it surpasses the quality of other smaller models including Gemini 1.5 Flash (79%) and Claude 3 Haiku (75%). What is particularly exciting is
Elon Musk
@elonmusk
Yup, same thing happening with real-world AI at Tesla
09:56 PM · July 18, 2024 · 164.3K views
57
107
2.5K