Claude Sonnet 5 · SWE-bench Multilingual(300 problems, 9 programming languages) 78.3% · 附件证据(ev5-swe-multilingual)

Claude Sonnet 5 的 SWE-bench Multilingual · 300 problems, 9 programming languages 官方出处。Standard configuration: adaptive thinking, max effort · 78.3%。见《Claude Sonnet 5 System Card》§8.2, PDF p.116。证据 ev5-swe-multilingual。

原文与定位

Claude Sonnet 5 · SWE-bench Multilingual(300 problems, 9 programming languages),Standard configuration: adaptive thinking, max effort配置,Pass rate 78.3%(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.2, PDF p.116。 查看成绩条件

Sonnet 5 achieved 78.3%. ● SWE-bench Multimodal 18 adds visual context (screenshots, design mockups) to the issue descriptions (see Section 9.3 of the Claude Opus 4.7 System Card for details on the internal harness).
官方材料
Claude Sonnet 5 System Card · PDF 第 116 页
定位
附件 · §8.2, PDF p.116
材料版本
PDF with changelog dated 2026-07-10; 146 pages; collected 2026-11-10
版本公布
未确认
披露时间
未确认 · 首发/后补未确认
采集时间
历史依据
暂无可靠历史版本依据
引用文本

Claude Sonnet 5 · SWE-bench Multilingual(300 problems, 9 programming languages),Standard configuration: adaptive thinking, max effort配置,Pass rate 78.3%(具体成绩公布时间未确认)。官方出处 Claude Sonnet 5 System Card(附件,PDF with changelog dated 2026-07-10; 146 pages; collected 2026-11-10)§8.2, PDF p.116,https://www.anthropic.com/claude-sonnet-5-system-card#page=116。Benchlog https://benchlog.lekshome.cc/evidence/claude-sonnet-5/ev5-swe-multilingual/

关联成绩与条件

Claude Sonnet 5 · SWE-bench Multilingual 成绩与配置
指标与成绩配置与评测条件证据关系
Pass rate78.3%原文 78.3% · 单位 %
公布 未确认
Standard configuration: adaptive thinking, max effort
设置
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
未知项
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
300 problems across 9 programming languages; five trials.
条件
Standard configuration; thinking blocks included in sampling results.

直接支持该成绩

在排名中查看此成绩