Agentic evaluation with extracted-text documents in a sandbox and code-execution tools; public Messages API; production safety classifiers active with fallback to Opus 4.8 on refusal; card-wide default max effort applies.
未知项
The exact run count is not stated in this section.
工具
允许工具
推理预算
max
框架
未记录
协议
OfficeQA Pro; 133-question subset; agentic extracted-text evaluation with code-execution tools.
条件
Public Messages API; safety classifiers and Opus 4.8 fallback active; max effort by card-wide default.
Claude Opus 5 · OfficeQA · Pro 133-question subset · Scores and configurations
Claude Opus 5 record for OfficeQA · Pro 133-question subset. 1 score record for this release, including 1 exact value (may include historical records). Includes 1 source location.
Claude Opus 5 · OfficeQA scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Exact-match accuracy66.9%Reported 66.9% · Unit %
Published Unconfirmed
OfficeQA / OfficeQA Pro · Messages API
Settings
Agentic evaluation with extracted-text documents in a sandbox and code-execution tools; public Messages API; production safety classifiers active with fallback to Opus 4.8 on refusal; card-wide default max effort applies.
Unknowns
The exact run count is not stated in this section.
Tools
Tools allowed
Reasoning budget
max
Framework
not recorded
Protocol
OfficeQA Pro; 133-question subset; agentic extracted-text evaluation with code-execution tools.
Conditions
Public Messages API; safety classifiers and Opus 4.8 fallback active; max effort by card-wide default.