工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026 final release, 108 tasks, three trials.
Toolathlon-Verified · June 2026 finalized release · Pass@1 · 工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026 final release, 108 tasks, three trials.
工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026; 108 tasks; Pass@1 averaged over three trials per task; adaptive thinking/max effort.
Toolathlon-Verified · June 2026 finalized release · Pass@1 · 工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026; 108 tasks; Pass@1 averaged over three trials per task; adaptive thinking/max effort.
工具条件未记录 / max / 框架未记录 · Toolathlon-Verified, at least one correct run across three trials on 108 tasks.
Toolathlon-Verified · June 2026 finalized release · Pass@3 · 工具条件未记录 / max / 框架未记录 · Toolathlon-Verified, at least one correct run across three trials on 108 tasks.
工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026; 108 tasks; at least one of three trials correct; adaptive thinking/max effort.
Toolathlon-Verified · June 2026 finalized release · Pass@3 · 工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026; 108 tasks; at least one of three trials correct; adaptive thinking/max effort.
工具条件未记录 / max / 框架未记录 · Average assistant turns per Toolathlon-Verified trajectory.
Toolathlon-Verified · June 2026 finalized release · Average assistant turns · 工具条件未记录 / max / 框架未记录 · Average assistant turns per Toolathlon-Verified trajectory.
工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026; average assistant turns per trajectory across 108 tasks and three trials.
Toolathlon-Verified · June 2026 finalized release · Average assistant turns · 工具条件未记录 / max / 框架未记录 · Toolathlon-Verified June 2026; average assistant turns per trajectory across 108 tasks and three trials.
Regular display scope. Rankings are grouped by metric and evaluation protocol. Recorded tool access, budgets, and frameworks are shown separately. Scores remain available for reference when conditions are unspecified.
Pass@1 %
Tool access not recorded / max / Framework not recorded · Toolathlon-Verified June 2026 final release, 108 tasks, three trials.
Toolathlon-Verified · June 2026 finalized release · Pass@1 · Tool access not recorded / max / Framework not recorded · Toolathlon-Verified June 2026 final release, 108 tasks, three trials.
Tool access not recorded / max / Framework not recorded · Toolathlon-Verified June 2026; 108 tasks; Pass@1 averaged over three trials per task; adaptive thinking/max effort.
Toolathlon-Verified · June 2026 finalized release · Pass@1 · Tool access not recorded / max / Framework not recorded · Toolathlon-Verified June 2026; 108 tasks; Pass@1 averaged over three trials per task; adaptive thinking/max effort.
Tool access not recorded / max / Framework not recorded · Toolathlon-Verified, at least one correct run across three trials on 108 tasks.
Toolathlon-Verified · June 2026 finalized release · Pass@3 · Tool access not recorded / max / Framework not recorded · Toolathlon-Verified, at least one correct run across three trials on 108 tasks.
Tool access not recorded / max / Framework not recorded · Toolathlon-Verified June 2026; 108 tasks; at least one of three trials correct; adaptive thinking/max effort.
Toolathlon-Verified · June 2026 finalized release · Pass@3 · Tool access not recorded / max / Framework not recorded · Toolathlon-Verified June 2026; 108 tasks; at least one of three trials correct; adaptive thinking/max effort.
Tool access not recorded / max / Framework not recorded · Toolathlon-Verified, all three runs correct on a task.
Toolathlon-Verified · June 2026 finalized release · Pass³ · Tool access not recorded / max / Framework not recorded · Toolathlon-Verified, all three runs correct on a task.
Tool access not recorded / max / Framework not recorded · Toolathlon-Verified June 2026; 108 tasks; all three trials correct; adaptive thinking/max effort.
Toolathlon-Verified · June 2026 finalized release · Pass³ · Tool access not recorded / max / Framework not recorded · Toolathlon-Verified June 2026; 108 tasks; all three trials correct; adaptive thinking/max effort.
Tool access not recorded / max / Framework not recorded · Average assistant turns per Toolathlon-Verified trajectory.
Toolathlon-Verified · June 2026 finalized release · Average assistant turns · Tool access not recorded / max / Framework not recorded · Average assistant turns per Toolathlon-Verified trajectory.
Tool access not recorded / max / Framework not recorded · Toolathlon-Verified June 2026; average assistant turns per trajectory across 108 tasks and three trials.
Toolathlon-Verified · June 2026 finalized release · Average assistant turns · Tool access not recorded / max / Framework not recorded · Toolathlon-Verified June 2026; average assistant turns per trajectory across 108 tasks and three trials.