Protocol Understanding · V2; Benchling-created evaluation using real laboratory protocols and applied questions; task count unspecified · Benchmark definition and scores
Protocol Understanding · V2; Benchling-created evaluation using real laboratory protocols and applied questions; task count unspecified has benchmark disclosures or scores across 3 model releases.
Regular display scope. Rankings are grouped by metric and evaluation protocol. Recorded tool access, budgets, and frameworks are shown separately. Scores remain available for reference when conditions are unspecified.
Score %
Tools allowed / max / Framework not recorded · Protocols Understanding V2; 119 Benchling-created held-out problems; bash, file editor and web-search tools; five attempts per problem unless otherwise stated.
Protocol Understanding · V2; Benchling-created evaluation using real laboratory protocols and applied questions; task count unspecified · Score · Tools allowed / max / Framework not recorded · Protocols Understanding V2; 119 Benchling-created held-out problems; bash, file editor and web-search tools; five attempts per problem unless otherwise stated.