Home Benchmark directory SWE-Lancer · IC Diamond set · Benchmark definition and scores SWE-Lancer · IC Diamond set · Benchmark definition and scores SWE-Lancer · IC Diamond set has benchmark disclosures or scores across 7 model releases.
Benchmark versions and metrics Aliases SWE-Lancer IC Diamond、SWE-Lancer IC SWE Diamond
Score · % · Higher is better Freelance coding task value · USD · Higher is better Latest models by series · reported scores Regular display scope. Rankings are grouped by metric and evaluation protocol. Recorded tool access, budgets, and frameworks are shown separately. Scores remain available for reference when conditions are unspecified.
Score % Tool access not recorded / xhigh / Framework not recorded · SWE-Lancer IC Diamond. SWE-Lancer · IC Diamond set · Score · Tool access not recorded / xhigh / Framework not recorded · SWE-Lancer IC Diamond. Model and configuration Score (%) Records and evidence GPT-5.3 Codex Xhigh 81.4%
History · 7 releases GPT-5.3 Codex 2026-02-05 1 score record for this release, including 1 exact value (may include historical records) GPT-5.2 Codex 2025-12-18 1 score record for this release, including 1 exact value (may include historical records) GPT-5.1 Codex-Max 2025-11-19 1 score record for this release, including 1 exact value (may include historical records) GPT-5.1 2025-11-12 1 score record for this release, including 1 exact value (may include historical records) GPT-5 2025-08-07 2 score records for this release, including 2 exact values (may include historical records) GPT-5 mini 2025-08-07 2 score records for this release, including 2 exact values (may include historical records) GPT-5 nano 2025-08-07 1 score record for this release, including 1 exact value (may include historical records)