Home Model series Claude Opus Claude Opus 4.8 Claude Opus 4.8 · OfficeQA · Full set · Scores and configurations Claude Opus 4.8 · OfficeQA · Full set · Scores and configurations Claude Opus 4.8 record for OfficeQA · Full set. 1 score record for this release, including 1 exact value (may include historical records). Includes 1 source location.
Scores and evaluation conditions Claude Opus 4.8 · OfficeQA scores and configurations Metric and score Configuration and evaluation conditions Sources Exact-match accuracy 77.6% Reported 77.6% · Unit % Published Unconfirmed
OfficeQA 内部 agentic harness Settings 从文档提取文本并放入 sandbox,提供 code execution;exact-match grading。OfficeQA Pro 为推荐的 133-question subset。与直接解析原始 PDF 的公开 harness 不可混比。 Unknowns none recorded Tools Tools allowed Reasoning budget not recorded Framework not recorded Protocol OfficeQA full set; exact-match grading. Conditions Internal agentic harness; documents extracted to text in sandbox with code execution. Not directly comparable to harnesses parsing raw PDFs. View this score in rankings
Benchmark versions and metrics Aliases OfficeQA
Exact-match accuracy · % · Higher is better