Claude Sonnet 5 · Humanity's Last Exam(2,500-question benchmark) · 附件证据(ev5-hle-method)

Claude Sonnet 5 的 Humanity's Last Exam · 2,500-question benchmark 官方出处。见《Claude Sonnet 5 System Card》§8.9.1, PDF p.122。证据 ev5-hle-method。

原文与定位

Claude Sonnet 5 · Humanity's Last Exam(2,500-question benchmark),Thinking set to auto配置,Accuracy 43.2%(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.9.1, PDF p.122。 查看成绩条件

Claude Sonnet 5 · Humanity's Last Exam(2,500-question benchmark),Thinking set to auto, with tools配置,Accuracy 57.4%(具体成绩公布时间未确认)。见《Claude Sonnet 5 System Card》§8.9.1, PDF p.122。 查看成绩条件

Humanity’s Last Exam (HLE) is a multi-modal benchmark at the frontier of human knowledge, comprising 2,500 questions. We tested Claude Sonnet 5 in two configurations: (1) reasoning-only without tools, and (2) with web search, web fetch, programmatic tool calling, and code execution. In all runs, thinking was set to auto and the total tokens used across contexts was capped at 1M. Context compaction was not used for these results. Claude Opus 4.6 served as the model grader.
官方材料
Claude Sonnet 5 System Card · PDF 第 122 页
定位
附件 · §8.9.1, PDF p.122
材料版本
PDF with changelog dated 2026-07-10; 146 pages; collected 2026-11-10
版本公布
未确认
披露时间
未确认 · 首发/后补未确认
采集时间
历史依据
暂无可靠历史版本依据
引用文本

Claude Sonnet 5 · Humanity's Last Exam(2,500-question benchmark),Thinking set to auto配置,Accuracy 43.2%(具体成绩公布时间未确认);Claude Sonnet 5 · Humanity's Last Exam(2,500-question benchmark),Thinking set to auto, with tools配置,Accuracy 57.4%(具体成绩公布时间未确认)。官方出处 Claude Sonnet 5 System Card(附件,PDF with changelog dated 2026-07-10; 146 pages; collected 2026-11-10)§8.9.1, PDF p.122,https://www.anthropic.com/claude-sonnet-5-system-card#page=122。Benchlog https://benchlog.lekshome.cc/evidence/claude-sonnet-5/ev5-hle-method/

关联成绩与条件

Claude Sonnet 5 · Humanity's Last Exam 成绩与配置
指标与成绩配置与评测条件证据关系
Accuracy43.2%原文 43.2% · 单位 %
公布 未确认
Thinking set to auto
设置
Thinking set to auto; no tools.
未知项
Exact effort selected by auto is not stated.
工具
禁止工具
推理预算
未记录
框架
未记录
协议
HLE, 2,500 questions; reasoning-only, no tools.
条件
Main-page summary table gives the exact score. System Card says thinking auto, total token limit 1M, no context compaction; exact effort selected by auto is unknown.

直接支持该成绩

在排名中查看此成绩
Accuracy57.4%原文 57.4% · 单位 %
公布 未确认
Thinking set to auto, with tools
设置
Thinking set to auto; web search, web fetch, programmatic tool calling and code execution.
未知项
Exact effort selected by auto is not stated.
工具
允许工具
推理预算
未记录
框架
未记录
协议
HLE, 2,500 questions; web search, web fetch, programmatic tool calling and code execution.
条件
Thinking auto; total token budget 1M, no context compaction; contamination blocklist and transcript review; Opus 4.6 grader.

直接支持该成绩

在排名中查看此成绩