Home Model series Claude Opus Claude Opus 5 Claude Opus 5 · AutomationBench · Zapier 私有 early-access set;版本未注明 · Scores and configurations Claude Opus 5 · AutomationBench · Zapier 私有 early-access set;版本未注明 · Scores and configurations Claude Opus 5 record for AutomationBench · Zapier 私有 early-access set;版本未注明. 2 score records for this release, including 2 exact values (may include historical records). Includes 2 source locations.
Scores and evaluation conditions Claude Opus 5 · AutomationBench scores and configurations Metric and score Configuration and evaluation conditions Sources Pass rate 26% Reported 26.0% · Unit % Published Unconfirmed
AutomationBench · max Settings Zapier private held-out evaluation set; max effort; benchmark version and task count not stated. Unknowns none recorded Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol Zapier AutomationBench private held-out leaderboard; pass rate. Conditions 26.0% at max effort; version/task release not stated; separate from the medium-effort 24% run. View this score in rankings Pass rate 24% Reported 24% · Unit % Published Unconfirmed
AutomationBench · medium Settings Zapier private held-out evaluation set; medium effort; result reports $0.89 per task. Unknowns none recorded Tools Tool access not recorded Reasoning budget medium Framework not recorded Protocol Zapier AutomationBench private held-out leaderboard; pass rate. Conditions Medium effort; reported cost $0.89/task; do not merge with max-effort 26.0%. View this score in rankings
Benchmark versions and metrics Aliases AutomationBench
Pass rate · % · Higher is better Cost per task · USD/task · Lower is better