Only settings explicitly listed in each result's conditions are known.
未知项
Effort, sampling and tool settings are unspecified unless stated in result.conditions.
工具
工具条件未记录
推理预算
未记录
框架
未记录
协议
OSWorld-Verified first-attempt success rate; default settings; 1080p; at most 100 action steps per task; five-run average.
条件
Effort, tools and model sampling settings are not specified in the benchmark section. The main article states scores from Sonnet 4.5 onward use OSWorld-Verified; Sonnet 5 later reports a changed protocol and a different 4.6 comparison value, noted in coverage.md but not imported as a 4.6 result.
Standard configuration: adaptive thinking, max effort
设置
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
未知项
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
OSWorld-Verified first-attempt success rate, five-run average; 361 tasks and 100 steps per task.
条件
Adaptive thinking at max effort, default 1080p settings. Protocol includes zoom-tool bug fix for batched actions and per-turn token limit increase from 16K to 128K; main page reports only Sonnet 5's score, not the Sonnet 4.6 cross-reference value.
Claude Sonnet · OSWorld-Verified · Verified benchmark; evaluation protocol noted per source · Release history
View scores, configurations, and disclosures for OSWorld-Verified · Verified benchmark; evaluation protocol noted per source across 2 Claude Sonnet releases, ordered by release date.
Differences are calculated only for unique, active, exact values between direct predecessors when the unit, metric, and explicitly recorded configuration and conditions match.
· 1 score record for this release, including 1 exact value (may include historical records)
Claude Sonnet 4.6 · OSWorld-Verified scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
First-attempt success rate72.5%Reported 72.5% · Unit %
Published Unconfirmed
Evaluation settings not fully stated
Settings
Only settings explicitly listed in each result's conditions are known.
Unknowns
Effort, sampling and tool settings are unspecified unless stated in result.conditions.
Tools
Tool access not recorded
Reasoning budget
not recorded
Framework
not recorded
Protocol
OSWorld-Verified first-attempt success rate; default settings; 1080p; at most 100 action steps per task; five-run average.
Conditions
Effort, tools and model sampling settings are not specified in the benchmark section. The main article states scores from Sonnet 4.5 onward use OSWorld-Verified; Sonnet 5 later reports a changed protocol and a different 4.6 comparison value, noted in coverage.md but not imported as a 4.6 result.
· 1 score record for this release, including 1 exact value (may include historical records)
Records for the direct predecessor do not provide matching conditions for a valid difference.
Claude Sonnet 5 · OSWorld-Verified scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
First-attempt success rate81.2%Reported 81.2% · Unit %
Published Unconfirmed
Standard configuration: adaptive thinking, max effort
Settings
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
Unknowns
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
Tools
Tool access not recorded
Reasoning budget
max
Framework
not recorded
Protocol
OSWorld-Verified first-attempt success rate, five-run average; 361 tasks and 100 steps per task.
Conditions
Adaptive thinking at max effort, default 1080p settings. Protocol includes zoom-tool bug fix for batched actions and per-turn token limit increase from 16K to 128K; main page reports only Sonnet 5's score, not the Sonnet 4.6 cross-reference value.