允许工具 / 推理预算未记录 / 框架未记录 · 82-task offline no-internet subset; max over 3 runs, one attempt each; official Docker/evaluator; 1080p, max 500 steps; Gemini CUA with batched calls.
OSWorld · 2.1, 82-task offline no-internet subset, partial score · Partial score · 允许工具 / 推理预算未记录 / 框架未记录 · 82-task offline no-internet subset; max over 3 runs, one attempt each; official Docker/evaluator; 1080p, max 500 steps; Gemini CUA with batched calls.
工具条件未记录 / max / 框架未记录 · OSWorld 2.1 official offline subset: 82/108 tasks; no internet; 1080p; maximum 500 action steps; pass@1 average across five attempts per task, max effort.
OSWorld · 2.1, 82-task offline no-internet subset, partial score · Partial score · 工具条件未记录 / max / 框架未记录 · OSWorld 2.1 official offline subset: 82/108 tasks; no internet; 1080p; maximum 500 action steps; pass@1 average across five attempts per task, max effort.
工具条件未记录 / max / 框架未记录 · OSWorld 2.1 official offline subset: 82/108 tasks; no internet; 1080p; maximum 500 action steps; pass@1 average across five attempts per task, max effort.
OSWorld · 2.1, 82-task offline no-internet subset, partial score · Strict pass rate · 工具条件未记录 / max / 框架未记录 · OSWorld 2.1 official offline subset: 82/108 tasks; no internet; 1080p; maximum 500 action steps; pass@1 average across five attempts per task, max effort.
Regular display scope. Rankings are grouped by metric and evaluation protocol. Recorded tool access, budgets, and frameworks are shown separately. Scores remain available for reference when conditions are unspecified.
Partial score %
Tool access not recorded / max / Framework not recorded · OSWorld 2.1 official 82-task offline set;partial score;Pass@1,五次尝试平均。
OSWorld · 2.1, 82-task offline no-internet subset, partial score · Partial score · Tool access not recorded / max / Framework not recorded · OSWorld 2.1 official 82-task offline set;partial score;Pass@1,五次尝试平均。
Tools allowed / Reasoning budget not recorded / Framework not recorded · 82-task offline no-internet subset; max over 3 runs, one attempt each; official Docker/evaluator; 1080p, max 500 steps; Gemini CUA with batched calls.
OSWorld · 2.1, 82-task offline no-internet subset, partial score · Partial score · Tools allowed / Reasoning budget not recorded / Framework not recorded · 82-task offline no-internet subset; max over 3 runs, one attempt each; official Docker/evaluator; 1080p, max 500 steps; Gemini CUA with batched calls.
Tool access not recorded / max / Framework not recorded · OSWorld 2.1 official offline subset: 82/108 tasks; no internet; 1080p; maximum 500 action steps; pass@1 average across five attempts per task, max effort.
OSWorld · 2.1, 82-task offline no-internet subset, partial score · Partial score · Tool access not recorded / max / Framework not recorded · OSWorld 2.1 official offline subset: 82/108 tasks; no internet; 1080p; maximum 500 action steps; pass@1 average across five attempts per task, max effort.
Tool access not recorded / max / Framework not recorded · OSWorld 2.1 official offline subset; 82/108 tasks, no internet, max effort, five attempts per task。
OSWorld · 2.1, 82-task offline no-internet subset, partial score · Partial score · Tool access not recorded / max / Framework not recorded · OSWorld 2.1 official offline subset; 82/108 tasks, no internet, max effort, five attempts per task。
Tool access not recorded / max / Framework not recorded · OSWorld 2.1 official offline subset: 82/108 tasks; no internet; 1080p; maximum 500 action steps; pass@1 average across five attempts per task, max effort.
OSWorld · 2.1, 82-task offline no-internet subset, partial score · Strict pass rate · Tool access not recorded / max / Framework not recorded · OSWorld 2.1 official offline subset: 82/108 tasks; no internet; 1080p; maximum 500 action steps; pass@1 average across five attempts per task, max effort.
Tool access not recorded / max / Framework not recorded · OSWorld 2.1 official offline subset; 82/108 tasks, no internet, max effort, five attempts per task。
OSWorld · 2.1, 82-task offline no-internet subset, partial score · Strict pass rate · Tool access not recorded / max / Framework not recorded · OSWorld 2.1 official offline subset; 82/108 tasks, no internet, max effort, five attempts per task。