Claude Opus 4.5 · Humanity's Last Exam · 2,500-question benchmark · 成绩与配置

Claude Opus 4.5 的 Humanity's Last Exam · 2,500-question benchmark 记录。本次发布有 3 条成绩记录,含 3 条精确值(可含历史记录),附 3 条来源定位。

成绩与评测条件

Claude Opus 4.5 · Humanity's Last Exam 成绩与配置
指标与成绩配置与评测条件出处
Accuracy30.8%原文 30.8% · 单位 %
公布 未确认
HLE reasoning-only, no tools
设置
Reasoning-only evaluation without tools; 2,500-question HLE benchmark.
未知项
Reasoning budget, trial count and other sampling settings are not stated.
工具
禁止工具
推理预算
未记录
框架
未记录
协议
Humanity's Last Exam, 2,500 questions; reasoning-only, no tools; Claude Sonnet 4.5 grader.
条件
Reasoning budget and trial count not stated.
在排名中查看此成绩
Accuracy43.2%原文 43.2% · 单位 %
公布 未确认
HLE tools-only, no reasoning
设置
Web search, web fetch and code execution; no reasoning.
未知项
Trial count and detailed tool budgets are not stated.
工具
允许工具
推理预算
未记录
框架
未记录
协议
Humanity's Last Exam, 2,500 questions; web search, web fetch and code execution; no reasoning; Claude Sonnet 4.5 grader.
条件
Tool budgets and trial count not stated. The search-enabled arm used transcript checks and manual review to flag likely online answer retrieval.
在排名中查看此成绩
Accuracy43.4%原文 43.4% · 单位 %
公布 未确认
Humanity's Last Exam · comparison article · with tools
设置
Web search/fetch, code execution, programmatic tool calling; context compaction at 50K up to 3M total tokens; max reasoning effort; adaptive thinking enabled.
未知项
Trial count and exact sampling settings for the Opus 4.5 row are not stated.
工具
允许工具
推理预算
max
框架
未记录
协议
Humanity's Last Exam, 2,500 questions; with tools.
条件
Web search/fetch, code execution and programmatic tool calling; 50K context compaction up to 3M total tokens; adaptive thinking and max reasoning effort. Kept separate from the System Card's 43.2% tools-only/no-reasoning result. 来源主文最初发布日期为2026-02-05,但当前HTML修改于2026-10-14;没有与此数值匹配的首发图像历史字节,因此精确首次公布日未知。
在排名中查看此成绩

出处与披露

测试版本与指标

别名 HLE、Humanity’s Last Exam、Humanity's Last Exam

  • Accuracy · % · 越高越好