Home Benchmark directory GPQA Diamond · Diamond subset; task snapshot unspecified · Benchmark definition and scores GPQA Diamond · Diamond subset; task snapshot unspecified · Benchmark definition and scores GPQA Diamond · Diamond subset; task snapshot unspecified has benchmark disclosures or scores across 9 model releases.
Benchmark versions and metrics Pass@1 · % · Higher is better Latest models by series · reported scores Regular display scope. Rankings are grouped by metric and evaluation protocol. Recorded tool access, budgets, and frameworks are shown separately. Scores remain available for reference when conditions are unspecified.
Pass@1 % Tool access not recorded / Output limit 64K tokens / Framework not recorded · Conditions not specified GPQA Diamond · Diamond subset; task snapshot unspecified · Pass@1 · Tool access not recorded / Output limit 64K tokens / Framework not recorded · Conditions not specified Model and configuration Score (%) Records and evidence DeepSeek-R1-0528 Not specified 81%
History · 9 releases DeepSeek-V4.1-Flash 2026-09-10 1 score record for this release, including 1 exact value (may include historical records) DeepSeek-V4-Flash (Preview) 2026-04-24 3 score records for this release, including 3 exact values (may include historical records) DeepSeek-V4-Pro (Preview) 2026-04-24 3 score records for this release, including 3 exact values (may include historical records) DeepSeek-V3.2-Exp 2025-09-29 1 score record for this release, including 1 exact value (may include historical records) DeepSeek-V3.1-Terminus 2025-09-22 1 score record for this release, including 1 exact value (may include historical records) DeepSeek-V3.1 2025-08-21 2 score records for this release, including 2 exact values (may include historical records) DeepSeek-R1-0528 2025-05-28 1 score record for this release, including 1 exact value (may include historical records) DeepSeek-R1 2025-01-20 1 score record for this release, including 1 exact value (may include historical records) DeepSeek-V3 2024-12-26 1 score record for this release, including 1 exact value (may include historical records)