工具条件未记录 / max / 框架未记录 · SWE-bench Multimodal; issue descriptions include screenshots/design mockups; mean of five trials.
SWE-bench Multimodal · Multimodal · Pass rate · 工具条件未记录 / max / 框架未记录 · SWE-bench Multimodal; issue descriptions include screenshots/design mockups; mean of five trials.
Regular display scope. Rankings are grouped by metric and evaluation protocol. Recorded tool access, budgets, and frameworks are shown separately. Scores remain available for reference when conditions are unspecified.
Pass rate %
Tool access not recorded / max / Framework not recorded · SWE-bench Multimodal; issue descriptions include screenshots/design mockups; mean of five trials.
SWE-bench Multimodal · Multimodal · Pass rate · Tool access not recorded / max / Framework not recorded · SWE-bench Multimodal; issue descriptions include screenshots/design mockups; mean of five trials.
Tool access not recorded / max / Framework not recorded · SWE-Bench Multimodal with screenshots and design mockups; five-trial average.
SWE-bench Multimodal · Multimodal · Pass rate · Tool access not recorded / max / Framework not recorded · SWE-Bench Multimodal with screenshots and design mockups; five-trial average.
Tool access not recorded / max / Framework not recorded · Visual issue context including screenshots and design mockups; five trials averaged.
SWE-bench Multimodal · Multimodal · Pass rate · Tool access not recorded / max / Framework not recorded · Visual issue context including screenshots and design mockups; five trials averaged.