Redactle LLM Leaderboard
I got nerd sniped and ran a bunch of evaluations to see how well models could play Redactle. It turns out Gemini flash is in a league of it's own in both performance and cost. It's able to one-shot every eval in a just a few seconds.
A compact comparison of how language models solve Redactle under distinct evaluation configurations.
LLM Leaderboard | Redactle New Game Settings Info LLM leaderboard News How to Play Stats More games Support R E DACTLE New Game Settings Info News How to Play Stats More games Support R E DACTLE A- A A+ Tabular Cosy system default system default light dark classic ragdoll wireframe forest garden red-actle English Français Español Deutsch Nederlands Italiano Português עברית العربية Türkçe Sign in Can an LLM solve a Redactle? Redactle is a puzzle game where a redacted Wikipedia article is displayed. Guessing a word reveals all matches in the article, including variations like 1 and one. Once the
A compact comparison of how language models solve Redactle under distinct evaluation configurations.
LLM Leaderboard | Redactle New Game Settings Info LLM leaderboard News How to Play Stats More games Support R E DACTLE New Game Settings Info News How to Play Stats More games Support R E DACTLE A- A A+ Tabular Cosy system default system default light dark classic ragdoll wireframe forest garden red-actle English Français Español Deutsch Nederlands Italiano Português עברית العربية Türkçe Sign in Can an LLM solve a Redactle? Redactle is a puzzle game where a redacted Wikipedia article is displayed. Guessing a word reveals all matches in the article, including variations like 1 and one. Once the
