SimpleQA · No search-enabled; report F1 · Benchmark definition and scores
SimpleQA · No search-enabled; report F1 has benchmark disclosures or scores across 4 model releases.
Benchmark versions and metrics
Aliases SimpleQA
- F1 · % · Higher is better
- Accuracy · % · Higher is better
- Hallucination rate · % · Lower is better
Latest models by series · reported scores
The latest models in each named series have no scores to display in this scope. Recorded historical data appears below.
History · 4 releases
- GPT-54 score records for this release, including 4 exact values (may include historical records)
- GPT-5 mini2 score records for this release, including 2 exact values (may include historical records)
- GPT-5 nano2 score records for this release, including 2 exact values (may include historical records)
- Gemini 2.5 Pro (GA)1 score record for this release, including 1 exact value (may include historical records)