Toolathlon-Verified · June 2026 finalized release · 测试定义与成绩

Toolathlon-Verified · June 2026 finalized release 收录 4 次模型发布的评测披露或成绩。

测试版本与指标

别名 Toolathlon-Verified

  • Pass@1 · % · 越高越好
  • Pass@3 · % · 越高越好
  • Pass³ · % · 越高越好
  • Average assistant turns · turns · 越低越好

各系列最新模型 · 公布成绩

常规展示范围。排名按指标与评测协议分组,已记录的工具、预算及框架分别展示。条件未说明的组保留公布值供查证。

Pass@1 %

工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026 final release, 108 tasks, three trials.

Toolathlon-Verified · June 2026 finalized release · Pass@1 · 工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026 final release, 108 tasks, three trials.
模型与配置成绩(%)记录与证据
Claude Sonnet 5.5Max77.8%

工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026; 108 tasks; Pass@1 averaged over three trials per task; adaptive thinking/max effort.

Toolathlon-Verified · June 2026 finalized release · Pass@1 · 工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026; 108 tasks; Pass@1 averaged over three trials per task; adaptive thinking/max effort.
模型与配置成绩(%)记录与证据
Claude Opus 5.5Max77.8%

Toolathlon-Verified official evaluation service; pass@1 averaged over 3 independent runs.

Toolathlon-Verified · June 2026 finalized release · Pass@1 · Toolathlon-Verified official evaluation service; pass@1 averaged over 3 independent runs.
模型与配置成绩(%)记录与证据
GLM-5.3未注明73%

Pass@3 %

工具条件未记录 / max / 框架未记录 · Toolathlon-Verified, at least one correct run across three trials on 108 tasks.

Toolathlon-Verified · June 2026 finalized release · Pass@3 · 工具条件未记录 / max / 框架未记录 · Toolathlon-Verified, at least one correct run across three trials on 108 tasks.
模型与配置成绩(%)记录与证据
Claude Sonnet 5.5Max85.2%

工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026; 108 tasks; at least one of three trials correct; adaptive thinking/max effort.

Toolathlon-Verified · June 2026 finalized release · Pass@3 · 工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026; 108 tasks; at least one of three trials correct; adaptive thinking/max effort.
模型与配置成绩(%)记录与证据
Claude Opus 5.5Max82.4%

Pass³ %

工具条件未记录 / max / 框架未记录 · Toolathlon-Verified, all three runs correct on a task.

Toolathlon-Verified · June 2026 finalized release · Pass³ · 工具条件未记录 / max / 框架未记录 · Toolathlon-Verified, all three runs correct on a task.
模型与配置成绩(%)记录与证据
Claude Sonnet 5.5Max68.5%

工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026; 108 tasks; all three trials correct; adaptive thinking/max effort.

Toolathlon-Verified · June 2026 finalized release · Pass³ · 工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026; 108 tasks; all three trials correct; adaptive thinking/max effort.
模型与配置成绩(%)记录与证据
Claude Opus 5.5Max72.2%

Average assistant turns turns

工具条件未记录 / max / 框架未记录 · Average assistant turns per Toolathlon-Verified trajectory.

Toolathlon-Verified · June 2026 finalized release · Average assistant turns · 工具条件未记录 / max / 框架未记录 · Average assistant turns per Toolathlon-Verified trajectory.
模型与配置成绩(turns)记录与证据
Claude Sonnet 5.5Max31.6 turns

工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026; average assistant turns per trajectory across 108 tasks and three trials.

Toolathlon-Verified · June 2026 finalized release · Average assistant turns · 工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026; average assistant turns per trajectory across 108 tasks and three trials.
模型与配置成绩(turns)记录与证据
Claude Opus 5.5Max26.9 turns

历史记录 · 4 次发布

  • Claude Sonnet 5.5本次发布有 4 条成绩记录,含 4 条精确值(可含历史记录)
  • Claude Opus 5.5本次发布有 4 条成绩记录,含 4 条精确值(可含历史记录)
  • Claude Fable 5.1本次发布有 4 条成绩记录,含 4 条精确值(可含历史记录)
  • GLM-5.3本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)