Same model. Similar pass rates. 17.5x cost differences across 12 harness configurations.
Codex DSH Creator Claude Code Pi DSH PTC DSH Standard Oh My Pi Kimi Code DSH Minimal Exo Harness OpenCode Hermes Cost Speed Pass rate 50.0% 55.6% 61.1% 66.7% $1 $2 $5 $10 $20 Codex 66.7% · $3.47 Codex 66.7% · $3.47 · 6m 43s DSH Creator 63.3% · $3.28 DSH Creator 63.3% · $3.28 · 6m 44s Claude Code 63.3% · $18.34 Claude Code 63.3% · $18.34 · 9m 38s Pi 60.0% · $2.43 Pi 60.0% · $2.43 · 7m 33s DSH PTC 60.0% · $4.58 DSH PTC 60.0% · $4.58 · 7m 44s DSH Standard 60.0% · $3.46 DSH Standard 60.0% · $3.46 · 6m 17s Oh My Pi 56.7% · $4.75 Oh My Pi 56.7% · $4.75 · 6m 46s Kimi Code 56.7% · $3.65 Kimi Code 56.7
Same model. Similar pass rates. 17.5x cost differences across 12 harness configurations.
Codex DSH Creator Claude Code Pi DSH PTC DSH Standard Oh My Pi Kimi Code DSH Minimal Exo Harness OpenCode Hermes Cost Speed Pass rate 50.0% 55.6% 61.1% 66.7% $1 $2 $5 $10 $20 Codex 66.7% · $3.47 Codex 66.7% · $3.47 · 6m 43s DSH Creator 63.3% · $3.28 DSH Creator 63.3% · $3.28 · 6m 44s Claude Code 63.3% · $18.34 Claude Code 63.3% · $18.34 · 9m 38s Pi 60.0% · $2.43 Pi 60.0% · $2.43 · 7m 33s DSH PTC 60.0% · $4.58 DSH PTC 60.0% · $4.58 · 7m 44s DSH Standard 60.0% · $3.46 DSH Standard 60.0% · $3.46 · 6m 17s Oh My Pi 56.7% · $4.75 Oh My Pi 56.7% · $4.75 · 6m 46s Kimi Code 56.7% · $3.65 Kimi Code 56.7
