允许工具 / high / 框架未记录 · Self-computed on canonical Partial 30 subset; average position score across independent k=2 runs; bash terminal, 1M context, H100 isolated sandbox, up to 256 tool calls and 20-minute command timeout.
MLE-Bench · Canonical Partial 30 subset · Average position score · 允许工具 / high / 框架未记录 · Self-computed on canonical Partial 30 subset; average position score across independent k=2 runs; bash terminal, 1M context, H100 isolated sandbox, up to 256 tool calls and 20-minute command timeout.
Regular display scope. Rankings are grouped by metric and evaluation protocol. Recorded tool access, budgets, and frameworks are shown separately. Scores remain available for reference when conditions are unspecified.
Average position score %
Tools allowed / high / Framework not recorded · Self-computed on canonical Partial 30 subset; average position score across independent k=2 runs; bash terminal, 1M context, H100 isolated sandbox, up to 256 tool calls and 20-minute command timeout.
MLE-Bench · Canonical Partial 30 subset · Average position score · Tools allowed / high / Framework not recorded · Self-computed on canonical Partial 30 subset; average position score across independent k=2 runs; bash terminal, 1M context, H100 isolated sandbox, up to 256 tool calls and 20-minute command timeout.