System Card §8.1 standard configuration: adaptive thinking at max effort; default temperature/top_p; averaged over 5 trials. Context sizes are evaluation-dependent and do not exceed 1M tokens; retain all section-specific exceptions on their results.
未知项
Per-benchmark tools, context/token cap, resolution, trial count, harness and other exceptions are recorded on each result when stated.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
SWE-bench Multimodal; visual context such as screenshots and design mockups.
条件
Published in the capability summary; evaluated on an internal harness (Appendix 8.3), so retain the harness qualifier and do not present as an externally reproduced run.
Adaptive thinking · max effort (card-wide default)
设置
System Card §8.1 default: adaptive thinking at max effort, default sampling settings (temperature/top_p), averaged over five trials unless otherwise noted; context varies by evaluation and does not exceed 1M tokens.
未知项
Per-benchmark exceptions and harness details are recorded on the relevant configurations/results.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
SWE-bench Multimodal; screenshot/mockup context; see §9.3 internal harness.
条件
Five-trial average; card-wide default adaptive max effort; harness details are in Appendix §9.3.
System Card max effort (per-result benchmark harnesses)
设置
System Card §8.1 default: adaptive thinking/max effort and default sampling settings unless a section says otherwise. Benchmark tools, evaluator, safeguards, fallback, and repetitions remain per-result conditions; this config represents the stated model effort, not harness equivalence.
未知项
Exact run time is not disclosed.、Per-benchmark tools, safeguards, and repetition counts are specified only where the source states them.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
Visual issue context including screenshots and design mockups; five trials averaged.
条件
Exact task count, tools and run date are not stated. Source-wide conditions: Each score is averaged over five trials; Multilingual has 300 problems across nine languages.
Differences are calculated only for unique, active, exact values between direct predecessors when the unit, metric, and explicitly recorded configuration and conditions match.
· 1 score record for this release, including 1 exact value (may include historical records)
Claude Opus 4.7 · SWE-bench Multimodal scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Pass rate34.5%Reported 34.5% · Unit %
Published Unconfirmed
发布表报告值
Settings
System Card §8.1 standard configuration: adaptive thinking at max effort; default temperature/top_p; averaged over 5 trials. Context sizes are evaluation-dependent and do not exceed 1M tokens; retain all section-specific exceptions on their results.
Unknowns
Per-benchmark tools, context/token cap, resolution, trial count, harness and other exceptions are recorded on each result when stated.
Tools
Tool access not recorded
Reasoning budget
max
Framework
not recorded
Protocol
SWE-bench Multimodal; visual context such as screenshots and design mockups.
Conditions
Published in the capability summary; evaluated on an internal harness (Appendix 8.3), so retain the harness qualifier and do not present as an externally reproduced run.
· 1 score record for this release, including 1 exact value (may include historical records)
Records for the direct predecessor do not provide matching conditions for a valid difference.
Claude Opus 5 · SWE-bench Multimodal scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Pass rate59.4%Reported 59.4% · Unit %
Published Unconfirmed
Adaptive thinking · max effort (card-wide default)
Settings
System Card §8.1 default: adaptive thinking at max effort, default sampling settings (temperature/top_p), averaged over five trials unless otherwise noted; context varies by evaluation and does not exceed 1M tokens.
Unknowns
Per-benchmark exceptions and harness details are recorded on the relevant configurations/results.
Tools
Tool access not recorded
Reasoning budget
max
Framework
not recorded
Protocol
SWE-bench Multimodal; screenshot/mockup context; see §9.3 internal harness.
Conditions
Five-trial average; card-wide default adaptive max effort; harness details are in Appendix §9.3.
· 1 score record for this release, including 1 exact value (may include historical records)
Records for the direct predecessor do not provide matching conditions for a valid difference.
Claude Opus 5.5 · SWE-bench Multimodal scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Pass rate61.4%Reported 61.4% · Unit %
Published Unconfirmed
System Card max effort (per-result benchmark harnesses)
Settings
System Card §8.1 default: adaptive thinking/max effort and default sampling settings unless a section says otherwise. Benchmark tools, evaluator, safeguards, fallback, and repetitions remain per-result conditions; this config represents the stated model effort, not harness equivalence.
Unknowns
Exact run time is not disclosed.、Per-benchmark tools, safeguards, and repetition counts are specified only where the source states them.
Tools
Tool access not recorded
Reasoning budget
max
Framework
not recorded
Protocol
Visual issue context including screenshots and design mockups; five trials averaged.
Conditions
Exact task count, tools and run date are not stated. Source-wide conditions: Each score is averaged over five trials; Multilingual has 300 problems across nine languages.