Claude Opus · BenchCAD Vision2Code · 1,000-file random subset of 17,900 files · 历代记录

按发布时间查看 Claude Opus 的 2 次发布在 BenchCAD Vision2Code · 1,000-file random subset of 17,900 files 的成绩、配置与披露。

仅为直接前代间的唯一、有效精确值计算差值,要求单位、指标与明确记录的配置和条件一致。

Claude Opus 5

· 本次发布有 2 条成绩记录,含 2 条精确值(可含历史记录)

Claude Opus 5 · BenchCAD Vision2Code 成绩与配置
指标与成绩配置与评测条件出处
Voxel IoU0.366原文 0.366 · 单位 未标注
公布 未确认
BenchCAD Vision2Code · no tools
设置
Max effort; 1,000-file random subset of 17,900; voxel IoU; five-run average; no tools.
未知项
未另记
工具
禁止工具
推理预算
max
框架
未记录
协议
BenchCAD Vision2Code; random 1,000-file subset of 17,900; voxel IoU.
条件
Max effort; no tools; five-run average.
在排名中查看此成绩
Voxel IoU0.821原文 0.821 · 单位 未标注
公布 未确认
BenchCAD Vision2Code · with tools
设置
Max effort; 1,000-file random subset of 17,900; container with images, standard libraries, and image-cropping tool; voxel IoU; five-run average.
未知项
未另记
工具
允许工具
推理预算
max
框架
未记录
协议
BenchCAD Vision2Code; random 1,000-file subset of 17,900; voxel IoU.
条件
Max effort; image container, standard libraries and cropping tool; five-run average.
在排名中查看此成绩

Claude Opus 5.5

· 本次发布有 2 条成绩记录,含 2 条精确值(可含历史记录)

与直接前代的记录缺少满足差值计算的同条件依据。

Claude Opus 5.5 · BenchCAD Vision2Code 成绩与配置
指标与成绩配置与评测条件出处
Voxel IoU0.73原文 0.730 voxel IoU without tools · 单位 未标注
公布 未确认
BenchCAD Vision2Code max effort, no tools
设置
Adaptive thinking/max effort; corrected 256 x 256 px per view implementation; random 1,000-file subset; five runs.
未知项
Task-level variance is not separately reported in the card text.
工具
禁止工具
推理预算
max
框架
未记录
协议
BenchCAD Vision2Code; random 1,000-file subset of 17,900; adaptive thinking/max effort; corrected 256 x 256 px per view implementation; five runs; no tools.
条件
Replaces the earlier 128 x 128 px implementation for model comparisons; not expressed as percent accuracy. Source-wide conditions: Corrected intended implementation uses 256 x 256 px per view, four views; random 1,000-file subset; max effort; five runs. Earlier 128 x 128 px implementation is not comparable.
在排名中查看此成绩
Voxel IoU0.962原文 0.962 voxel IoU with tools · 单位 未标注
公布 未确认
BenchCAD Vision2Code max effort, with tools
设置
Adaptive thinking/max effort; container, standard libraries, and image-cropping tool; corrected 256 x 256 px per view implementation; random 1,000-file subset; five runs.
未知项
Task-level variance is not separately reported in the card text.
工具
允许工具
推理预算
max
框架
未记录
协议
BenchCAD Vision2Code; random 1,000-file subset of 17,900; adaptive thinking/max effort; corrected 256 x 256 px per view implementation; container, libraries, and crop tool; five runs.
条件
Replaces the earlier 128 x 128 px implementation for model comparisons; not expressed as percent accuracy. Source-wide conditions: Corrected intended implementation uses 256 x 256 px per view, four views; random 1,000-file subset; max effort; five runs. Earlier 128 x 128 px implementation is not comparable.
在排名中查看此成绩