Home Model series Claude Sonnet Claude Sonnet 5.5 Claude Sonnet 5.5 · ProgramBench · 166 个保留的 golden tasks;架构与时限按协议区分 · Scores and configurations Claude Sonnet 5.5 · ProgramBench · 166 个保留的 golden tasks;架构与时限按协议区分 · Scores and configurations Claude Sonnet 5.5 record for ProgramBench · 166 个保留的 golden tasks;架构与时限按协议区分. 1 score record for this release, including 1 exact value (may include historical records). Includes 2 source locations.
Scores and evaluation conditions Claude Sonnet 5.5 · ProgramBench scores and configurations Metric and score Configuration and evaluation conditions Sources Hidden test pass rate 79.7% Reported 79.7% · Unit % Published Unconfirmed
Adaptive thinking, max effort Settings Adaptive thinking enabled; max effort. Unknowns Sampling settings may vary by benchmark; see each result.conditions. Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol ProgramBench, 166 tasks after excluding 34 flaky reference binaries; hidden-test pass rate over five episodes. Conditions mini-swe-agent; no six-hour upstream time limit; fresh context budget up to 1M tokens per episode. View this score in rankings
Benchmark versions and metrics Aliases ProgramBench、Multi-Agent ProgramBench
Hidden test pass rate · % · Higher is better Score · Unit not specified · Higher is better