Claude Opus 4.7 · Humanity's Last Exam · 2,500-question benchmark · 成绩与配置

Claude Opus 4.7 的 Humanity's Last Exam · 2,500-question benchmark 记录。本次发布有 7 条成绩记录,含 7 条精确值(可含历史记录),附 3 条来源定位。

成绩与评测条件

Claude Opus 4.7 · Humanity's Last Exam 成绩与配置
指标与成绩配置与评测条件出处
Accuracy46.9%原文 46.9% · 单位 %
公布 未确认
HLE 无工具
设置
HLE reasoning-only, no tools; thinking auto; max reasoning effort; total tokens across contexts capped at 1M; no context compaction; Claude Opus 4.6 grader; standard five-trial average applies to the headline result.
未知项
The card does not state a separate headline trial count; the §8.1 standard average of five trials applies.
工具
禁止工具
推理预算
max
框架
未记录
协议
HLE; no tools。
条件
2,500 questions; reasoning-only, no tools; thinking auto; max reasoning effort; total context tokens capped at 1M; no context compaction; Opus 4.6 grader; §8.1 five-trial average applies.
在排名中查看此成绩
Accuracy54.7%原文 54.7% · 单位 %
公布 未确认
HLE 有工具
设置
HLE with web search, web fetch, programmatic tool calling and code execution; thinking auto; max reasoning effort; total tokens across contexts capped at 1M; no context compaction; Claude Opus 4.6 grader; known HLE sources blocklisted and transcripts reviewed.
未知项
The card does not state a separate headline trial count; the §8.1 standard average of five trials applies. Single-run effort-chart points use distinct configs.
工具
允许工具
推理预算
max
框架
未记录
协议
HLE; with tools。
条件
2,500 questions; web search, web fetch, programmatic tool calling and code execution; thinking auto; max reasoning effort; 1M total-token cap; no context compaction; HLE source blocklist and Opus 4.6 transcript review; §8.1 five-trial average applies.
在排名中查看此成绩
Accuracy43%原文 43.0% · 单位 %
公布 未确认
HLE工具评测,low effort单次
设置
With tools; thinking auto; low effort; one run; total token cap 1M; no context compaction.
未知项
未另记
工具
允许工具
推理预算
low
框架
未记录
协议
HLE with web search, web fetch, programmatic tools and code execution; low effort.
条件
Single run; thinking auto; total token cap 1M; no context compaction.
在排名中查看此成绩
Accuracy48.4%原文 48.4% · 单位 %
公布 未确认
HLE工具评测,medium effort单次
设置
With tools; thinking auto; medium effort; one run; total token cap 1M; no context compaction.
未知项
未另记
工具
允许工具
推理预算
medium
框架
未记录
协议
HLE with tools; medium effort.
条件
Single run; thinking auto; total token cap 1M; no context compaction.
在排名中查看此成绩
Accuracy53.2%原文 53.2% · 单位 %
公布 未确认
HLE工具评测,high effort单次
设置
With tools; thinking auto; high effort; one run; total token cap 1M; no context compaction.
未知项
未另记
工具
允许工具
推理预算
high
框架
未记录
协议
HLE with tools; high effort.
条件
Single run; thinking auto; total token cap 1M; no context compaction.
在排名中查看此成绩
Accuracy55.4%原文 55.4% · 单位 %
公布 未确认
HLE工具评测,xhigh effort单次
设置
With tools; thinking auto; xhigh effort; one run; total token cap 1M; no context compaction.
未知项
未另记
工具
允许工具
推理预算
xhigh
框架
未记录
协议
HLE with tools; xhigh effort.
条件
Single run; thinking auto; total token cap 1M; no context compaction.
在排名中查看此成绩
Accuracy54.7%原文 54.7% · 单位 %
公布 未确认
HLE工具评测,max effort单次
设置
With tools; thinking auto; max effort; one run; total token cap 1M; no context compaction.
未知项
未另记
工具
允许工具
推理预算
max
框架
未记录
协议
HLE with tools; max effort; single run.
条件
Figure 8.8.1.B; thinking auto; 1M total-token cap; no context compaction. Keep separate from the §8.1 standard multi-trial headline result.
在排名中查看此成绩

出处与披露

测试版本与指标

别名 HLE、Humanity’s Last Exam、Humanity's Last Exam

  • Accuracy · % · 越高越好