Claude Sonnet 4.6 · SWE-bench Verified(Verified subset (500 problems)) 80.2% · 附件证据(ev46-swe-prompt)

Claude Sonnet 4.6 的 SWE-bench Verified · Verified subset (500 problems) 官方出处。Adaptive thinking, max effort · 80.2%。见《Claude Sonnet 4.6 System Card》§2.2, PDF p.16, prompt modification paragraph。证据 ev46-swe-prompt。

原文与定位

Claude Sonnet 4.6 · SWE-bench Verified(Verified subset (500 problems)),Adaptive thinking, max effort配置,Pass rate 80.2%(具体成绩公布时间未确认)。见《Claude Sonnet 4.6 System Card》§2.2, PDF p.16, prompt modification paragraph。 查看成绩条件

For SWE-bench Verified, we found that the following prompt modification resulted in a score of 80.2%: You should use tools as much as possible, ideally more than 100 times.
官方材料
Claude Sonnet 4.6 System Card · PDF 第 16 页
定位
附件 · §2.2, PDF p.16, prompt modification paragraph
材料版本
PDF with changelog dated 2026-03-06; 135 pages; collected 2026-11-10
版本公布
未确认
披露时间
未确认 · 首发/后补未确认
采集时间
历史依据
暂无可靠历史版本依据
引用文本

Claude Sonnet 4.6 · SWE-bench Verified(Verified subset (500 problems)),Adaptive thinking, max effort配置,Pass rate 80.2%(具体成绩公布时间未确认)。官方出处 Claude Sonnet 4.6 System Card(附件,PDF with changelog dated 2026-03-06; 135 pages; collected 2026-11-10)§2.2, PDF p.16, prompt modification paragraph,https://www.anthropic.com/claude-sonnet-4-6-system-card#page=16。Benchlog https://benchlog.lekshome.cc/evidence/claude-sonnet-4-6/ev46-swe-prompt/

关联成绩与条件

Claude Sonnet 4.6 · SWE-bench Verified 成绩与配置
指标与成绩配置与评测条件证据关系
Pass rate80.2%原文 80.2% · 单位 %
公布 未确认
Adaptive thinking, max effort
设置
Adaptive thinking enabled; max effort; default temperature and top_p unless an evaluation specifies otherwise.
未知项
Context window is evaluation-dependent; Table 2.1.A states it does not exceed 1M tokens.
工具
允许工具
推理预算
max
框架
未记录
协议
SWE-bench Verified with a prompt modification.
条件
Prompt asks for extensive tool use and testing; separate modified-prompt result, not the default run.

直接支持该成绩

在排名中查看此成绩