| Accuracy56.3%Reported 56.3% · Unit % Published Unconfirmed | HLE · thinking auto, no tools- Settings
- Reasoning-only configuration; thinking=auto; 1M total-token cap across contexts; no context compaction; Opus 4.6 model grader.
- Unknowns
- The headline result does not identify a low-to-max effort setting.
- Tools
- Tools forbidden
- Reasoning budget
- max
- Framework
- not recorded
- Protocol
- Humanity’s Last Exam; reasoning-only, without tools.
- Conditions
- 56.3%; thinking=auto; 1M total-token cap across contexts; no context compaction; Opus 4.6 grader. This headline run is distinct from explicit low-to-max effort charts.
| View this score in rankings |
|---|
| Accuracy64.7%Reported 64.7% · Unit % Published Unconfirmed | HLE · thinking auto, with tools- Settings
- Web search, web fetch, programmatic tool calling, and code execution; thinking=auto; 1M total-token cap across contexts; no context compaction; Opus 4.6 grader; HLE-specific URL blocklist and transcript contamination review.
- Unknowns
- The headline result does not identify a low-to-max effort setting.
- Tools
- Tools allowed
- Reasoning budget
- max
- Framework
- not recorded
- Protocol
- Humanity’s Last Exam; web search, web fetch, programmatic tool calling, and code execution.
- Conditions
- 64.7%; thinking=auto; 1M total-token cap across contexts; no context compaction; Opus 4.6 grader; blocklist and transcript contamination review. Distinct from explicit effort charts.
| View this score in rankings |
|---|
| Accuracy56.1%Reported 56.1% · Unit % Published Unconfirmed | HLE effort sweep · with tools · Low effort- Settings
- Tools enabled; explicit figure-labeled effort scaling; billed API cost reported. This is separate from the headline thinking=auto run. Explicit adaptive-thinking effort: low.
- Unknowns
- The card does not state any additional sampling parameters beyond the cited evaluation description.
- Tools
- Tools allowed
- Reasoning budget
- low
- Framework
- not recorded
- Protocol
- HLE effort-scaling figure; with tools.
- Conditions
- Explicit effort labels; billed API actuals; separate from the headline thinking=auto result; figure does not state a token cap or context-compaction setting.
| View this score in rankings |
|---|
| Accuracy61.3%Reported 61.3% · Unit % Published Unconfirmed | HLE effort sweep · with tools · Medium effort- Settings
- Tools enabled; explicit figure-labeled effort scaling; billed API cost reported. This is separate from the headline thinking=auto run. Explicit adaptive-thinking effort: medium.
- Unknowns
- The card does not state any additional sampling parameters beyond the cited evaluation description.
- Tools
- Tools allowed
- Reasoning budget
- medium
- Framework
- not recorded
- Protocol
- HLE effort-scaling figure; with tools.
- Conditions
- Explicit effort labels; billed API actuals; separate from the headline thinking=auto result; figure does not state a token cap or context-compaction setting.
| View this score in rankings |
|---|
| Accuracy63.2%Reported 63.2% · Unit % Published Unconfirmed | HLE effort sweep · with tools · High effort- Settings
- Tools enabled; explicit figure-labeled effort scaling; billed API cost reported. This is separate from the headline thinking=auto run. Explicit adaptive-thinking effort: high.
- Unknowns
- The card does not state any additional sampling parameters beyond the cited evaluation description.
- Tools
- Tools allowed
- Reasoning budget
- high
- Framework
- not recorded
- Protocol
- HLE effort-scaling figure; with tools.
- Conditions
- Explicit effort labels; billed API actuals; separate from the headline thinking=auto result; figure does not state a token cap or context-compaction setting.
| View this score in rankings |
|---|
| Accuracy64.8%Reported 64.8% · Unit % Published Unconfirmed | HLE effort sweep · with tools · Xhigh effort- Settings
- Tools enabled; explicit figure-labeled effort scaling; billed API cost reported. This is separate from the headline thinking=auto run. Explicit adaptive-thinking effort: xhigh.
- Unknowns
- The card does not state any additional sampling parameters beyond the cited evaluation description.
- Tools
- Tools allowed
- Reasoning budget
- xhigh
- Framework
- not recorded
- Protocol
- HLE effort-scaling figure; with tools.
- Conditions
- Explicit effort labels; billed API actuals; separate from the headline thinking=auto result; figure does not state a token cap or context-compaction setting.
| View this score in rankings |
|---|
| Accuracy64.7%Reported 64.7% · Unit % Published Unconfirmed | HLE effort sweep · with tools · Max effort- Settings
- Tools enabled; explicit figure-labeled effort scaling; billed API cost reported. This is separate from the headline thinking=auto run. Explicit adaptive-thinking effort: max.
- Unknowns
- The card does not state any additional sampling parameters beyond the cited evaluation description.
- Tools
- Tools allowed
- Reasoning budget
- max
- Framework
- not recorded
- Protocol
- HLE effort-scaling figure; with tools.
- Conditions
- Explicit effort labels; billed API actuals; separate from the headline thinking=auto result; figure does not state a token cap or context-compaction setting.
| View this score in rankings |
|---|
| Accuracy47.8%Reported 47.8% · Unit % Published Unconfirmed | HLE effort sweep · no tools · Low effort- Settings
- No tools; explicit figure-labeled effort scaling; billed API cost reported. This is separate from the headline thinking=auto run. Explicit adaptive-thinking effort: low.
- Unknowns
- The card does not state any additional sampling parameters beyond the cited evaluation description.
- Tools
- Tools forbidden
- Reasoning budget
- low
- Framework
- not recorded
- Protocol
- HLE effort-scaling figure; no tools.
- Conditions
- Explicit effort labels; separate from the headline thinking=auto result; figure does not state a token cap or context-compaction setting.
| View this score in rankings |
|---|
| Accuracy54.2%Reported 54.2% · Unit % Published Unconfirmed | HLE effort sweep · no tools · Medium effort- Settings
- No tools; explicit figure-labeled effort scaling; billed API cost reported. This is separate from the headline thinking=auto run. Explicit adaptive-thinking effort: medium.
- Unknowns
- The card does not state any additional sampling parameters beyond the cited evaluation description.
- Tools
- Tools forbidden
- Reasoning budget
- medium
- Framework
- not recorded
- Protocol
- HLE effort-scaling figure; no tools.
- Conditions
- Explicit effort labels; separate from the headline thinking=auto result; figure does not state a token cap or context-compaction setting.
| View this score in rankings |
|---|
| Accuracy56%Reported 56% · Unit % Published Unconfirmed | HLE effort sweep · no tools · High effort- Settings
- No tools; explicit figure-labeled effort scaling; billed API cost reported. This is separate from the headline thinking=auto run. Explicit adaptive-thinking effort: high.
- Unknowns
- The card does not state any additional sampling parameters beyond the cited evaluation description.
- Tools
- Tools forbidden
- Reasoning budget
- high
- Framework
- not recorded
- Protocol
- HLE effort-scaling figure; no tools.
- Conditions
- Explicit effort labels; separate from the headline thinking=auto result; figure does not state a token cap or context-compaction setting.
| View this score in rankings |
|---|
| Accuracy57.6%Reported 57.6% · Unit % Published Unconfirmed | HLE effort sweep · no tools · Xhigh effort- Settings
- No tools; explicit figure-labeled effort scaling; billed API cost reported. This is separate from the headline thinking=auto run. Explicit adaptive-thinking effort: xhigh.
- Unknowns
- The card does not state any additional sampling parameters beyond the cited evaluation description.
- Tools
- Tools forbidden
- Reasoning budget
- xhigh
- Framework
- not recorded
- Protocol
- HLE effort-scaling figure; no tools.
- Conditions
- Explicit effort labels; separate from the headline thinking=auto result; figure does not state a token cap or context-compaction setting.
| View this score in rankings |
|---|
| Accuracy56.5%Reported 56.5% · Unit % Published Unconfirmed | HLE effort sweep · no tools · Max effort- Settings
- No tools; explicit figure-labeled effort scaling; billed API cost reported. This is separate from the headline thinking=auto run. Explicit adaptive-thinking effort: max.
- Unknowns
- The card does not state any additional sampling parameters beyond the cited evaluation description.
- Tools
- Tools forbidden
- Reasoning budget
- max
- Framework
- not recorded
- Protocol
- HLE effort-scaling figure; no tools.
- Conditions
- Explicit effort labels; separate from the headline thinking=auto result; figure does not state a token cap or context-compaction setting.
| View this score in rankings |
|---|