Home Benchmark directory GPQA Diamond · 198-question Diamond subset · Benchmark definition and scores GPQA Diamond · 198-question Diamond subset · Benchmark definition and scores GPQA Diamond · 198-question Diamond subset has benchmark disclosures or scores across 24 model releases.
Benchmark versions and metrics Aliases GPQA Diamond、GPQA (diamond)
Accuracy · % · Higher is better Latest models by series · reported scores Regular display scope. Rankings are grouped by metric and evaluation protocol. Recorded tool access, budgets, and frameworks are shown separately. Scores remain available for reference when conditions are unspecified.
Accuracy % Tool access not recorded / xhigh / Framework not recorded · Conditions not specified GPQA Diamond · 198-question Diamond subset · Accuracy · Tool access not recorded / xhigh / Framework not recorded · Conditions not specified Model and configuration Score (%) Records and evidence GPT-5.5 Xhigh 93.6%
Tool access not recorded / xhigh / Framework not recorded · GPQA Diamond; tool access not separately stated in the table. GPQA Diamond · 198-question Diamond subset · Accuracy · Tool access not recorded / xhigh / Framework not recorded · GPQA Diamond; tool access not separately stated in the table. Rank Model and configuration Score (%) Records and evidence 1 GPT-5.4 mini Xhigh 88% 2 GPT-5.4 nano Xhigh 82.8%
Tools forbidden / high / Framework not recorded · No tools GPQA Diamond · 198-question Diamond subset · Accuracy · Tools forbidden / high / Framework not recorded · No tools Model and configuration Score (%) Records and evidence Gemini 3.1 Pro High 94.3%
History · 24 releases GPT-6.2 Astra 2026-11-18 1 score record for this release, including 1 exact value (may include historical records) GPT-6.2 Sol 2026-11-18 1 score record for this release, including 1 exact value (may include historical records) GPT-6 Astra 2026-09-03 7 score records for this release, including 7 exact values (may include historical records) GPT-5.6 Sol 2026-07-09 1 score record for this release, including 1 exact value (may include historical records) GPT-5.6 Luna 2026-07-09 1 score record for this release, including 1 exact value (may include historical records) GPT-5.6 Terra 2026-07-09 1 score record for this release, including 1 exact value (may include historical records) Claude Opus 4.8 2026-05-28 1 score record for this release, including 1 exact value (may include historical records) GPT-5.5 2026-04-23 1 score record for this release, including 1 exact value (may include historical records) Claude Opus 4.7 2026-04-16 1 score record for this release, including 1 exact value (may include historical records) GPT-5.4 mini 2026-03-17 1 score record for this release, including 1 exact value (may include historical records) GPT-5.4 nano 2026-03-17 1 score record for this release, including 1 exact value (may include historical records) GPT-5.4 2026-03-05 3 score records for this release, including 3 exact values (may include historical records) Gemini 3.1 Pro 2026-02-19 1 score record for this release, including 1 exact value (may include historical records) Claude Sonnet 4.6 2026-02-17 1 score record for this release, including 1 exact value (may include historical records) Claude Opus 4.6 2026-02-05 1 score record for this release, including 1 exact value (may include historical records) GPT-5.2 2025-12-11 2 score records for this release, including 2 exact values (may include historical records) Claude Opus 4.5 2025-11-24 1 score record for this release, including 1 exact value (may include historical records) Gemini 3 Pro 2025-11-18 1 score record for this release, including 1 exact value (may include historical records) GPT-5.1 2025-11-12 1 score record for this release, including 1 exact value (may include historical records) Claude Haiku 4.5 2025-10-15 1 score record for this release, including 1 exact value (may include historical records) GPT-5 2025-08-07 2 score records for this release, including 2 exact values (may include historical records) GPT-5 mini 2025-08-07 1 score record for this release, including 1 exact value (may include historical records) GPT-5 nano 2025-08-07 1 score record for this release, including 1 exact value (may include historical records) Gemini 2.5 Pro (GA) 2025-06-17 1 score record for this release, including 1 exact value (may include historical records)