Benchmarks
DeepSWE results for ten coding harnesses on one model, with the method, the tables and the per-task records.
5 benchmark pages · updatedCheapest coding agent per solved issue: ten harnesses comparedOn DeepSWE with every harness on DeepSeek V4 Flash, CodeAF cost 39.9 cents per solved task, the lowest of ten; the next was 1.9x that. Method and table.DeepSWE results: ten coding agents on one model (2026)CodeAF solved 62 of 113 DeepSWE tasks (54.9%) at the lowest cost per solved issue of ten harnesses on DeepSeek V4 Flash. Method, versions, tables.Which coding agent solves the harder DeepSWE tasks?On the 76 medium and hard DeepSWE tasks, CodeAF solved 36, ahead of mini-swe-agent's 30 and Codex CLI's 29, with all ten harnesses on one model.Best coding agent for Go and Python on DeepSWE (2026)CodeAF solved the most Go (21 of 34) and Python (20 of 34) DeepSWE tasks of ten harnesses on one model. Results by language, with the table.CodeAF head to head with nine coding agents on DeepSWETask by task on 113 DeepSWE tasks, CodeAF solved more tasks the other harness missed than the reverse, against all nine harnesses on one model.