Home Model series Claude Opus Claude Opus 4.8 Claude Opus 4.8 · OfficeQA · Pro 133-question subset · Scores and configurations Claude Opus 4.8 · OfficeQA · Pro 133-question subset · Scores and configurations Claude Opus 4.8 record for OfficeQA · Pro 133-question subset. 1 score record for this release, including 1 exact value (may include historical records). Includes 1 source location.
Scores and evaluation conditions Claude Opus 4.8 · OfficeQA scores and configurations Metric and score Configuration and evaluation conditions Sources Exact-match accuracy 66.2% Reported 66.2% · Unit % Published Unconfirmed
OfficeQA 内部 agentic harness Settings 从文档提取文本并放入 sandbox,提供 code execution;exact-match grading。OfficeQA Pro 为推荐的 133-question subset。与直接解析原始 PDF 的公开 harness 不可混比。 Unknowns none recorded Tools Tools allowed Reasoning budget not recorded Framework not recorded Protocol OfficeQA Pro, harder 133-question subset; exact-match grading. Conditions Internal agentic harness; documents extracted to text in sandbox with code execution. Not directly comparable to harnesses parsing raw PDFs. View this score in rankings
Benchmark versions and metrics Aliases OfficeQA Pro
Exact-match accuracy · % · Higher is better