Home Benchmark directory SWE-bench Pro · Pro · Benchmark definition and scores SWE-bench Pro · Pro · Benchmark definition and scores SWE-bench Pro · Pro has benchmark disclosures or scores across 10 model releases.
Benchmark versions and metrics Aliases SWE-Bench Pro
Pass rate · % · Higher is better Latest models by series · reported scores Regular display scope. Rankings are grouped by metric and evaluation protocol. Recorded tool access, budgets, and frameworks are shown separately. Scores remain available for reference when conditions are unspecified.
Pass rate % SWE-bench Pro;effort、harness 和运行数未注明。 SWE-bench Pro · Pro · Pass rate · SWE-bench Pro;effort、harness 和运行数未注明。 Model and configuration Score (%) Records and evidence Claude Fable 5.2 Not specified 93%
Tool access not recorded / max / Framework not recorded · SWE-Bench Pro; score averaged over five trials. SWE-bench Pro · Pro · Pass rate · Tool access not recorded / max / Framework not recorded · SWE-Bench Pro; score averaged over five trials. Model and configuration Score (%) Records and evidence Claude Haiku 5.5 Max 64.8%
Tool access not recorded / max / Framework not recorded · SWE-Bench Pro; five-trial average. SWE-bench Pro · Pro · Pass rate · Tool access not recorded / max / Framework not recorded · SWE-Bench Pro; five-trial average. Model and configuration Score (%) Records and evidence Claude Sonnet 5.5 Max 81.3%
Tool access not recorded / max / Framework not recorded · SWE-bench Pro; five trials averaged. SWE-bench Pro · Pro · Pass rate · Tool access not recorded / max / Framework not recorded · SWE-bench Pro; five trials averaged. Model and configuration Score (%) Records and evidence Claude Opus 5.5 Max 89.9%
History · 10 releases Claude Fable 5.2 2026-11-09 1 score record for this release, including 1 exact value (may include historical records) Claude Haiku 5.5 2026-10-07 1 score record for this release, including 1 exact value (may include historical records) Claude Sonnet 5.5 2026-09-28 1 score record for this release, including 1 exact value (may include historical records) Claude Opus 5.5 2026-09-22 1 score record for this release, including 1 exact value (may include historical records) Claude Fable 5.1 2026-09-15 1 score record for this release, including 1 exact value (may include historical records) Claude Opus 5 2026-07-24 1 score record for this release, including 1 exact value (may include historical records) Claude Sonnet 5 2026-06-30 1 score record for this release, including 1 exact value (may include historical records) Claude Opus 4.8 2026-05-28 1 score record for this release, including 1 exact value (may include historical records) Claude Opus 4.7 2026-04-16 1 score record for this release, including 1 exact value (may include historical records) Claude Opus 4.5 2025-11-24 2 score records for this release, including 2 exact values (may include historical records)