OSWorld 2.1 official offline subset: 82 of 108 tasks, no internet, 1080p, max 500 action steps; partial score and strict pass rate are pass@1 averaged over five independent attempts per task at max effort.
未知项
System Card 当前修订日期未给出。
工具
工具条件未记录
推理预算
max
框架
未记录
协议
OSWorld 2.1 official offline subset: 82/108 tasks; no internet; 1080p; maximum 500 action steps; pass@1 average across five attempts per task, max effort.
条件
Partial score is mean per-task credit across checkpoints.
OSWorld 2.1 official offline subset: 82 of 108 tasks, no internet, 1080p, max 500 action steps; partial score and strict pass rate are pass@1 averaged over five independent attempts per task at max effort.
未知项
System Card 当前修订日期未给出。
工具
工具条件未记录
推理预算
max
框架
未记录
协议
OSWorld 2.1 official offline subset: 82/108 tasks; no internet; 1080p; maximum 500 action steps; pass@1 average across five attempts per task, max effort.
条件
Strict pass rate counts tasks where every checkpoint is satisfied.
Claude Haiku 5.5 · OSWorld · 2.1, 82-task offline no-internet subset, partial score · Scores and configurations
Claude Haiku 5.5 record for OSWorld · 2.1, 82-task offline no-internet subset, partial score. 2 score records for this release, including 2 exact values (may include historical records). Includes 2 source locations.
Claude Haiku 5.5 · OSWorld scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Partial score72.4%Reported 72.4% partial (offline subset) · Unit %
Published Unconfirmed
OSWorld 2.1 offline subset
Settings
OSWorld 2.1 official offline subset: 82 of 108 tasks, no internet, 1080p, max 500 action steps; partial score and strict pass rate are pass@1 averaged over five independent attempts per task at max effort.
Unknowns
System Card 当前修订日期未给出。
Tools
Tool access not recorded
Reasoning budget
max
Framework
not recorded
Protocol
OSWorld 2.1 official offline subset: 82/108 tasks; no internet; 1080p; maximum 500 action steps; pass@1 average across five attempts per task, max effort.
Conditions
Partial score is mean per-task credit across checkpoints.
OSWorld 2.1 official offline subset: 82 of 108 tasks, no internet, 1080p, max 500 action steps; partial score and strict pass rate are pass@1 averaged over five independent attempts per task at max effort.
Unknowns
System Card 当前修订日期未给出。
Tools
Tool access not recorded
Reasoning budget
max
Framework
not recorded
Protocol
OSWorld 2.1 official offline subset: 82/108 tasks; no internet; 1080p; maximum 500 action steps; pass@1 average across five attempts per task, max effort.
Conditions
Strict pass rate counts tasks where every checkpoint is satisfied.