Standard configuration: adaptive thinking, max effort
设置
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
未知项
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
工具
允许工具
推理预算
max
框架
未记录
协议
BrowseComp with web search, web fetch, programmatic tool calling and code execution.
条件
Adaptive thinking, max effort, 10M token limit, 200K context compaction, evaluation blocklist. Original page chart was replaced after the source identified a simpler methodology; prior numeric value was not given and is not reconstructed.
Adaptive thinking at max effort with web search, web fetch, programmatic tool calling, and code execution; 3M-token limit; context compaction is reported as triggering at 200K tokens when extending beyond the 1M context window.
未知项
Sampling parameters are not stated.
工具
允许工具
推理预算
max
框架
未记录
协议
BrowseComp Figure 8.9.2.A, test-time compute scaling at max effort with web search, web fetch, programmatic tool calling, and code execution.
条件
3M-token limit as labeled; §8.9.2 reports context compaction triggered at 200K tokens to extend beyond the 1M context window. The figure gives no exact per-point cost label.
Claude Sonnet 5 · BrowseComp · 1,266 题;单代理与多代理按协议区分 · Scores and configurations
Claude Sonnet 5 record for BrowseComp · 1,266 题;单代理与多代理按协议区分. 3 score records for this release, including 3 exact values (may include historical records). Includes 4 source locations.
Claude Sonnet 5 · BrowseComp scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Accuracy84.7%Reported 84.7% · Unit %
Published Unconfirmed
Standard configuration: adaptive thinking, max effort
Settings
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
Unknowns
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
Tools
Tools allowed
Reasoning budget
max
Framework
not recorded
Protocol
BrowseComp with web search, web fetch, programmatic tool calling and code execution.
Conditions
Adaptive thinking, max effort, 10M token limit, 200K context compaction, evaluation blocklist. Original page chart was replaced after the source identified a simpler methodology; prior numeric value was not given and is not reconstructed.
Adaptive thinking at max effort with web search, web fetch, programmatic tool calling, and code execution; 3M-token limit; context compaction is reported as triggering at 200K tokens when extending beyond the 1M context window.
Unknowns
Sampling parameters are not stated.
Tools
Tools allowed
Reasoning budget
max
Framework
not recorded
Protocol
BrowseComp Figure 8.9.2.A, test-time compute scaling at max effort with web search, web fetch, programmatic tool calling, and code execution.
Conditions
3M-token limit as labeled; §8.9.2 reports context compaction triggered at 200K tokens to extend beyond the 1M context window. The figure gives no exact per-point cost label.