Claude Sonnet 5 · Toolathlon(June 2026 release used in selected source) · 附件证据(ev5-toolathlon)

Claude Sonnet 5 的 Toolathlon · June 2026 release used in selected source 官方出处。见《Claude Sonnet 5 System Card》§8.11.5 Table 8.11.5.A, PDF pp.134-135。证据 ev5-toolathlon。

原文与定位

Claude Sonnet 5 · Toolathlon(June 2026 release used in selected source),Standard configuration: adaptive thinking, max effort配置,Pass@1 54.3%(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.11.5 Table 8.11.5.A, PDF pp.134-135。 查看成绩条件

Claude Sonnet 5 · Toolathlon(June 2026 release used in selected source),Standard configuration: adaptive thinking, max effort配置,Pass@3 63%(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.11.5 Table 8.11.5.A, PDF pp.134-135。 查看成绩条件

Claude Sonnet 5 · Toolathlon(June 2026 release used in selected source),Standard configuration: adaptive thinking, max effort配置,Pass³ 40.7%(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.11.5 Table 8.11.5.A, PDF pp.134-135。 查看成绩条件

Claude Sonnet 5 · Toolathlon(June 2026 release used in selected source),Standard configuration: adaptive thinking, max effort配置,Average assistant turns 26 turns(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.11.5 Table 8.11.5.A, PDF pp.134-135。 查看成绩条件

[Table 8.11.5.A] Model | Pass@1 | Pass@3 | Pass3 | Avg turns; Claude Sonnet 5 | 54.3 | 63.0 | 40.7 | 26.0. Toolathlon scores using an internal harness.
官方材料
Claude Sonnet 5 System Card · PDF 第 135 页
定位
附件 · §8.11.5 Table 8.11.5.A, PDF pp.134-135
材料版本
PDF with changelog dated 2026-07-10; 146 pages; collected 2026-11-10
版本公布
未确认
披露时间
未确认 · 首发/后补未确认
采集时间
历史依据
暂无可靠历史版本依据
引用文本

Claude Sonnet 5 · Toolathlon(June 2026 release used in selected source),Standard configuration: adaptive thinking, max effort配置,Pass@1 54.3%(具体成绩公布时间未确认);Claude Sonnet 5 · Toolathlon(June 2026 release used in selected source),Standard configuration: adaptive thinking, max effort配置,Pass@3 63%(具体成绩公布时间未确认);Claude Sonnet 5 · Toolathlon(June 2026 release used in selected source),Standard configuration: adaptive thinking, max effort配置,Pass³ 40.7%(具体成绩公布时间未确认);Claude Sonnet 5 · Toolathlon(June 2026 release used in selected source),Standard configuration: adaptive thinking, max effort配置,Average assistant turns 26 turns(具体成绩公布时间未确认)。官方出处 Claude Sonnet 5 System Card(附件,PDF with changelog dated 2026-07-10; 146 pages; collected 2026-11-10)§8.11.5 Table 8.11.5.A, PDF pp.134-135,https://www.anthropic.com/claude-sonnet-5-system-card#page=135。Benchlog https://benchlog.lekshome.cc/evidence/claude-sonnet-5/ev5-toolathlon/

关联成绩与条件

Claude Sonnet 5 · Toolathlon 成绩与配置
指标与成绩配置与评测条件证据关系
Pass@154.3%原文 54.3% · 单位 %
公布 未确认
Standard configuration: adaptive thinking, max effort
设置
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
未知项
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
Toolathlon 108 tasks, three trials, internal harness.
条件
Adaptive thinking and max effort; offline snapshots pin financial feeds and container images; about a quarter of tasks are unsatisfiable as published.

直接支持该成绩

在排名中查看此成绩
Pass@363%原文 63.0% · 单位 %
公布 未确认
Standard configuration: adaptive thinking, max effort
设置
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
未知项
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
Toolathlon 108 tasks; at least one correct result across three trials.
条件
Adaptive thinking and max effort; internal harness with pinned dependencies.

直接支持该成绩

在排名中查看此成绩
Pass³40.7%原文 40.7% · 单位 %
公布 未确认
Standard configuration: adaptive thinking, max effort
设置
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
未知项
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
Toolathlon 108 tasks; all three attempts correct.
条件
Adaptive thinking and max effort; internal harness with pinned dependencies.

直接支持该成绩

在排名中查看此成绩
Average assistant turns26 turns原文 26.0 · 单位 turns
公布 未确认
Standard configuration: adaptive thinking, max effort
设置
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
未知项
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
Average assistant turns per trajectory on Toolathlon.
条件
Adaptive thinking and max effort; three trials per task.

直接支持该成绩

在排名中查看此成绩