Gemini 4 Argon plays StarCraft
I've refreshed StarSkirmish Bench, a benchmark where LLMs play StarCraft BW by writing code, with results from the flagship models of OpenAI, Anthropic, Google, and Muse
StarSkirmish: where LLMs write code to play StarCraft.
StarSkirmish Bench v0.2 Bench Kai McPheeters · October 15, 2026 TL;DR StarSkirmish is a benchmark where LLMs write bots for StarCraft: Brood War Each LLM gets one hour to write a Protoss bot in C++, which is then evaluated against other LLMs' bots and established human written bots StarSkirmish tests long horizon reasoning and agentic coding as LLMs must incorporate learnings from practice games to improve their StarCraft bot StarSkirmish Bench v0.2 The StarSkirmish Bench evaluates how strong of a StarCraft bot can each LLM write given 1 hour of wall clock time. v0.2 updates StarSkirmish Bench
StarSkirmish: where LLMs write code to play StarCraft.
StarSkirmish Bench v0.2 Bench Kai McPheeters · October 15, 2026 TL;DR StarSkirmish is a benchmark where LLMs write bots for StarCraft: Brood War Each LLM gets one hour to write a Protoss bot in C++, which is then evaluated against other LLMs' bots and established human written bots StarSkirmish tests long horizon reasoning and agentic coding as LLMs must incorporate learnings from practice games to improve their StarCraft bot StarSkirmish Bench v0.2 The StarSkirmish Bench evaluates how strong of a StarCraft bot can each LLM write given 1 hour of wall clock time. v0.2 updates StarSkirmish Bench
Related listings
Practise reading music by naming each note of a score as the cursor reaches it
Offline desktop suite with 63 image, video, and audio tools for fast local media processing, batch workflows, and one-ti...
