Terminus-2 harness; 1× guaranteed / 3× ceiling resource allocation; 5–15 samples per task across staggered batches, as stated by the comparison article.
未知项
The article does not identify whether the Opus 4.5 value is an Anthropic reproduction or a result published by another lab, and does not state effort or the exact sample count for this row.
工具
工具条件未记录
推理预算
未记录
框架
Terminus-2
协议
Terminal-Bench 2.0; Opus 4.5 value from the Opus 4.6 comparison table.
条件
Terminus-2; 1× guaranteed / 3× ceiling resource allocation; article reports 5–15 samples per task across staggered batches. Effort and whether this value was reproduced by Anthropic or published by another lab are not identified. Kept distinct from the System Card's 59.27% ±1.34% result at 128K and 1,335 trials. 来源主文最初发布日期为2026-02-05,但当前HTML修改于2026-10-14;没有与此数值匹配的首发图像历史字节,因此精确首次公布日未知。
System Card §8.1 standard configuration: adaptive thinking at max effort; default temperature/top_p; averaged over 5 trials. Context sizes are evaluation-dependent and do not exceed 1M tokens; retain all section-specific exceptions on their results.
未知项
Per-benchmark tools, context/token cap, resolution, trial count, harness and other exceptions are recorded on each result when stated.
89 unique tasks; five attempts per task, 445 trials total; isolated Kubernetes pods with benchmark resource limits and timeouts; production API endpoint.
Differences are calculated only for unique, active, exact values between direct predecessors when the unit, metric, and explicitly recorded configuration and conditions match.
Terminus-2 harness; 1× guaranteed / 3× ceiling resource allocation; 5–15 samples per task across staggered batches, as stated by the comparison article.
Unknowns
The article does not identify whether the Opus 4.5 value is an Anthropic reproduction or a result published by another lab, and does not state effort or the exact sample count for this row.
Tools
Tool access not recorded
Reasoning budget
not recorded
Framework
Terminus-2
Protocol
Terminal-Bench 2.0; Opus 4.5 value from the Opus 4.6 comparison table.
Conditions
Terminus-2; 1× guaranteed / 3× ceiling resource allocation; article reports 5–15 samples per task across staggered batches. Effort and whether this value was reproduced by Anthropic or published by another lab are not identified. Kept distinct from the System Card's 59.27% ±1.34% result at 128K and 1,335 trials. 来源主文最初发布日期为2026-02-05,但当前HTML修改于2026-10-14;没有与此数值匹配的首发图像历史字节,因此精确首次公布日未知。
· 1 score record for this release, including 1 exact value (may include historical records)
Records for the direct predecessor do not provide matching conditions for a valid difference.
Claude Opus 4.7 · Terminal-Bench scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Mean reward69.4%Reported 69.4% · Unit %
Published Unconfirmed
发布表报告值
Settings
System Card §8.1 standard configuration: adaptive thinking at max effort; default temperature/top_p; averaged over 5 trials. Context sizes are evaluation-dependent and do not exceed 1M tokens; retain all section-specific exceptions on their results.
Unknowns
Per-benchmark tools, context/token cap, resolution, trial count, harness and other exceptions are recorded on each result when stated.
89 unique tasks; five attempts per task, 445 trials total; isolated Kubernetes pods with benchmark resource limits and timeouts; production API endpoint.