Claude Opus 5 · DeepSWE · v1.1 · 成绩与配置

Claude Opus 5 的 DeepSWE · v1.1 记录。本次发布有 5 条成绩记录,含 5 条精确值(可含历史记录),附 3 条来源定位。

成绩与评测条件

Claude Opus 5 · DeepSWE 成绩与配置
指标与成绩配置与评测条件出处
Score68.8%原文 68.8% · 单位 %
公布 未确认
DeepSWE v1.1 · Max effort
设置
113 long-horizon software-engineering tasks; Figure 8.3.A effort/cost sweep. The figure does not state effort-specific trial counts. Explicit adaptive-thinking effort: max.
未知项
The card does not state any additional sampling parameters beyond the cited evaluation description.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
DeepSWE v1.1; §8.3 prose reports the max-effort summary score; Figure 8.3.A max point is 68.8%.
条件
68.8%, average over five trials. Keep distinct effort-sweep points as separate results.
在排名中查看此成绩
Score57.7%原文 57.7% · 单位 %
公布 未确认
DeepSWE v1.1 · Low effort
设置
113 long-horizon software-engineering tasks; Figure 8.3.A effort/cost sweep. The figure does not state effort-specific trial counts. Explicit adaptive-thinking effort: low.
未知项
The card does not state any additional sampling parameters beyond the cited evaluation description.
工具
工具条件未记录
推理预算
low
框架
未记录
协议
DeepSWE v1.1; Figure 8.3.A effort/cost sweep.
条件
113 long-horizon coding tasks; explicit figure-labeled effort; figure-specific run count not stated. Keep the chart series distinct from the prose/table max value, which is also 68.8%.
在排名中查看此成绩
Score66.9%原文 66.9% · 单位 %
公布 未确认
DeepSWE v1.1 · Medium effort
设置
113 long-horizon software-engineering tasks; Figure 8.3.A effort/cost sweep. The figure does not state effort-specific trial counts. Explicit adaptive-thinking effort: medium.
未知项
The card does not state any additional sampling parameters beyond the cited evaluation description.
工具
工具条件未记录
推理预算
medium
框架
未记录
协议
DeepSWE v1.1; Figure 8.3.A effort/cost sweep.
条件
113 long-horizon coding tasks; explicit figure-labeled effort; figure-specific run count not stated. Keep the chart series distinct from the prose/table max value, which is also 68.8%.
在排名中查看此成绩
Score68%原文 68% · 单位 %
公布 未确认
DeepSWE v1.1 · High effort
设置
113 long-horizon software-engineering tasks; Figure 8.3.A effort/cost sweep. The figure does not state effort-specific trial counts. Explicit adaptive-thinking effort: high.
未知项
The card does not state any additional sampling parameters beyond the cited evaluation description.
工具
工具条件未记录
推理预算
high
框架
未记录
协议
DeepSWE v1.1; Figure 8.3.A effort/cost sweep.
条件
113 long-horizon coding tasks; explicit figure-labeled effort; figure-specific run count not stated. Keep the chart series distinct from the prose/table max value, which is also 68.8%.
在排名中查看此成绩
Score69.7%原文 69.7% · 单位 %
公布 未确认
DeepSWE v1.1 · Xhigh effort
设置
113 long-horizon software-engineering tasks; Figure 8.3.A effort/cost sweep. The figure does not state effort-specific trial counts. Explicit adaptive-thinking effort: xhigh.
未知项
The card does not state any additional sampling parameters beyond the cited evaluation description.
工具
工具条件未记录
推理预算
xhigh
框架
未记录
协议
DeepSWE v1.1; Figure 8.3.A effort/cost sweep.
条件
113 long-horizon coding tasks; explicit figure-labeled effort; figure-specific run count not stated. Keep the chart series distinct from the prose/table max value, which is also 68.8%.
在排名中查看此成绩

出处与披露

测试版本与指标

别名 DeepSWE v1.1

  • Score · % · 越高越好