Claude Sonnet 4.6 · OpenRCA(335 enterprise software failure cases) · 附件证据(ev46-openrca)

Claude Sonnet 4.6 的 OpenRCA · 335 enterprise software failure cases 官方出处。见《Claude Sonnet 4.6 System Card》§2.4 Table 2.4.A, PDF p.18, Overall row。证据 ev46-openrca。

原文与定位

Claude Sonnet 4.6 · OpenRCA(335 enterprise software failure cases),Adaptive thinking, high effort配置,Root-cause identification score 27.9%(具体成绩公布时间未确认)。见《Claude Sonnet 4.6 System Card》§2.4 Table 2.4.A, PDF p.18, Overall row。 查看成绩条件

Claude Sonnet 4.6 · OpenRCA(335 enterprise software failure cases),Adaptive thinking, max effort配置,Root-cause identification score 26.4%(具体成绩公布时间未确认)。见《Claude Sonnet 4.6 System Card》§2.4 Table 2.4.A, PDF p.18, Overall row。 查看成绩条件

Claude Sonnet 4.6 scored 27.9% overall, a meaningful improvement over Claude Sonnet 4.5 (12.9%). OpenRCA was described in a peer-reviewed paper and is grounded in real enterprise telemetry, but it is a simplified proxy: the dataset does not heavily test reasoning across complex service dependency chains. Model Overall Claude Sonnet 4.6 (Adaptive thinking, high effort) 27.9% Claude Sonnet 4.6 (Adaptive thinking, max effort) 26.4% Claude Opus 4.6 (Thinking enabled, default effort) 34.9% Claude Opus 4.5 26.9% Claude Sonnet 4.5 12.9% GPT-5.2 19.4% Gemini 3 Pro 12.5% [Table 2.4.A] All Anthropic reported scores are 3-run averages.
官方材料
Claude Sonnet 4.6 System Card · PDF 第 18 页
定位
附件 · §2.4 Table 2.4.A, PDF p.18, Overall row
材料版本
PDF with changelog dated 2026-03-06; 135 pages; collected 2026-11-10
版本公布
未确认
披露时间
未确认 · 首发/后补未确认
采集时间
历史依据
暂无可靠历史版本依据
引用文本

Claude Sonnet 4.6 · OpenRCA(335 enterprise software failure cases),Adaptive thinking, high effort配置,Root-cause identification score 27.9%(具体成绩公布时间未确认);Claude Sonnet 4.6 · OpenRCA(335 enterprise software failure cases),Adaptive thinking, max effort配置,Root-cause identification score 26.4%(具体成绩公布时间未确认)。官方出处 Claude Sonnet 4.6 System Card(附件,PDF with changelog dated 2026-03-06; 135 pages; collected 2026-11-10)§2.4 Table 2.4.A, PDF p.18, Overall row,https://www.anthropic.com/claude-sonnet-4-6-system-card#page=18。Benchlog https://benchlog.lekshome.cc/evidence/claude-sonnet-4-6/ev46-openrca/

关联成绩与条件

Claude Sonnet 4.6 · OpenRCA 成绩与配置
指标与成绩配置与评测条件证据关系
Root-cause identification score27.9%原文 27.9% · 单位 %
公布 未确认
Adaptive thinking, high effort
设置
Adaptive thinking enabled; high effort.
未知项
Sampling settings are not specified in every evaluation.
工具
工具条件未记录
推理预算
high
框架
未记录
协议
335-case benchmark; author's agent harness; three-run average.
条件
Adaptive thinking, high effort. Scores range 0-100% and measure root-cause identification.

直接支持该成绩

在排名中查看此成绩
Root-cause identification score26.4%原文 26.4% · 单位 %
公布 未确认
Adaptive thinking, max effort
设置
Adaptive thinking enabled; max effort; default temperature and top_p unless an evaluation specifies otherwise.
未知项
Context window is evaluation-dependent; Table 2.1.A states it does not exceed 1M tokens.
工具
工具条件未记录
推理预算
max
框架
未记录
协议
335-case benchmark; author's agent harness; three-run average.
条件
Adaptive thinking, max effort. Separate configuration from the high-effort result.

直接支持该成绩

在排名中查看此成绩