Andrej Karpathy

@karpathy · 1. Feb. 2025

I quite like the idea using games to evaluate LLMs against each other, instead of fixed evals. Playing against another intelligent entity self-balances and adapts difficulty, so each eval (/environment) is leveraged a lot more. There's some early attempts around. Exciting area.

León@LeonGuertler· 31. Jan. 2025

@karpathy Perfect timing, we are just about to publish TextArena. A collection of 57 text-based games (30 in the first release) including single-player, two-player and multi-player games. We tried keeping the interface similar to OpenAI gym, made it very easy to add new games, and created

Elon Musk

@elonmusk

Yeah

18:13 · 1. Februar 2025 · 38.287 Aufrufe

660

X →