Home Model series Claude Sonnet Claude Sonnet 4.6 Claude Sonnet 4.6 · Vending-Bench · 2 · Scores and configurations Claude Sonnet 4.6 · Vending-Bench · 2 · Scores and configurations Claude Sonnet 4.6 record for Vending-Bench · 2. 3 score records for this release, including 3 exact values (may include historical records). Includes 2 source locations.
Scores and evaluation conditions Claude Sonnet 4.6 · Vending-Bench scores and configurations Metric and score Configuration and evaluation conditions Sources Final bank balance $7,204.14 USD Reported $7,204.14 · Unit USD Published Unconfirmed
Vending-Bench 2 max effort Settings Max effort as named for this benchmark. Unknowns The report does not state whether adaptive thinking was enabled. Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol One-year simulated vending-machine business, $500 starting balance. Conditions Max effort; benchmark's own context management; Claude context editing disabled. View this score in rankings Final bank balance $6,625.10 USD Reported $6,625.10 · Unit USD Published Unconfirmed
Vending-Bench 2 high effort Settings High effort as named for this benchmark. Unknowns The report does not state whether adaptive thinking was enabled. Tools Tool access not recorded Reasoning budget high Framework not recorded Protocol One-year simulated vending-machine business, $500 starting balance. Conditions High effort; benchmark's own context management; Claude context editing disabled. View this score in rankings Mean run cost $265.03 USD Reported $265.03 · Unit USD Published Unconfirmed
Vending-Bench 2 max effort Settings Max effort as named for this benchmark. Unknowns The report does not state whether adaptive thinking was enabled. Tools Tool access not recorded Reasoning budget max Framework not recorded Protocol Mean run cost for Vending-Bench 2. Conditions Max effort; the source does not state the number of runs used for cost aggregation. View this score in rankings
Benchmark versions and metrics Aliases Vending-Bench 2
Final bank balance · USD · Higher is better Mean run cost · USD · Lower is better Mean net worth · USD · Higher is better