Home Model series Claude Sonnet Claude Sonnet 5 Claude Sonnet 5 · SWE-bench Multimodal · Multimodal · Scores and configurations Claude Sonnet 5 · SWE-bench Multimodal · Multimodal · Scores and configurations Claude Sonnet 5 record for SWE-bench Multimodal · Multimodal. 1 score record for this release, including 1 exact value (may include historical records). Includes 1 source location.
Scores and evaluation conditions Claude Sonnet 5 · SWE-bench Multimodal scores and configurations Metric and score Configuration and evaluation conditions Sources Pass rate 28.1% Reported 28.1% · Unit % Published Unconfirmed
Standard configuration: adaptive thinking, max effort Settings Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated. Unknowns Context-window size is evaluation-dependent; standard configuration is 1M tokens. Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol SWE-bench Multimodal with screenshots and design mockups in issue descriptions; five trials. Conditions Standard configuration; thinking blocks included in sampling results. View this score in rankings
Sources and disclosures §8.2, PDF p.116 Attachment · Claude Sonnet 5 System Card Benchmark versions and metrics Aliases SWE-Bench Multimodal
Pass rate · % · Higher is better