Zapier 无 fallback model;safeguard intervention 记失败。 Source-wide conditions: Private held-out Zapier evaluation. The existing result is retained; this System Card evidence does not specify a benchmark release for the 40.0% score.
Claude Opus · AutomationBench · Zapier 私有 early-access set;版本未注明 · Release history
View scores, configurations, and disclosures for AutomationBench · Zapier 私有 early-access set;版本未注明 across 2 Claude Opus releases, ordered by release date.
Differences are calculated only for unique, active, exact values between direct predecessors when the unit, metric, and explicitly recorded configuration and conditions match.
Zapier 无 fallback model;safeguard intervention 记失败。 Source-wide conditions: Private held-out Zapier evaluation. The existing result is retained; this System Card evidence does not specify a benchmark release for the 40.0% score.