Andrej Karpathy

@karpathy · Feb 1, 2025

I quite like the idea using games to evaluate LLMs against each other, instead of fixed evals. Playing against another intelligent entity self-balances and adapts difficulty, so each eval (/environment) is leveraged a lot more. There's some early attempts around. Exciting area.

León@LeonGuertler· Jan 31, 2025

@karpathy Perfect timing, we are just about to publish TextArena. A collection of 57 text-based games (30 in the first release) including single-player, two-player and multi-player games. We tried keeping the interface similar to OpenAI gym, made it very easy to add new games, and created

Elon Musk

@elonmusk

Yeah

06:13 PM · February 1, 2025 · 38.3K views

660

X →