Home Model series Claude Sonnet Claude Sonnet 5 Claude Sonnet 5 · SWE-bench Multilingual · 300 problems, 9 programming languages · Scores and configurations Claude Sonnet 5 · SWE-bench Multilingual · 300 problems, 9 programming languages · Scores and configurations Claude Sonnet 5 record for SWE-bench Multilingual · 300 problems, 9 programming languages. 1 score record for this release, including 1 exact value (may include historical records). Includes 1 source location.
Scores and evaluation conditions Claude Sonnet 5 · SWE-bench Multilingual scores and configurations Metric and score Configuration and evaluation conditions Sources Pass rate 78.3% Reported 78.3% · Unit % Published Unconfirmed
Standard configuration: adaptive thinking, max effort Settings Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated. Unknowns Context-window size is evaluation-dependent; standard configuration is 1M tokens. Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol 300 problems across 9 programming languages; five trials. Conditions Standard configuration; thinking blocks included in sampling results. View this score in rankings
Sources and disclosures §8.2, PDF p.116 Attachment · Claude Sonnet 5 System Card Benchmark versions and metrics Aliases SWE-Bench Multilingual
Pass rate · % · Higher is better