Claude Fable 5.1 · OSWorld(2.0,August 2026 task release(与此前 task files 不可直接比较)) · 附件证据(ev-f51-card-osworld)

Claude Fable 5.1 的 OSWorld · 2.0,August 2026 task release(与此前 task files 不可直接比较) 官方出处。见《Claude Fable 5.1 and Claude Mythos 5.1 System Card》本地留存副本, PDF p.189。证据 ev-f51-card-osworld。

原文与定位

Claude Fable 5.1 · OSWorld(2.0,August 2026 task release(与此前 task files 不可直接比较)),Adaptive Max配置,Partial score 77.9%(具体成绩公布时间未确认)。见《Claude Fable 5.1 and Claude Mythos 5.1 System Card》本地留存副本, PDF p.189。 查看成绩条件

Claude Fable 5.1 · OSWorld(2.0,August 2026 task release(与此前 task files 不可直接比较)),Adaptive Max配置,Strict pass rate 41.7%(具体成绩公布时间未确认)。见《Claude Fable 5.1 and Claude Mythos 5.1 System Card》本地留存副本, PDF p.189。 查看成绩条件

Claude Fable 5.1 achieved a partial score of 77.9% and a strict pass rate of 41.7% on the authors’ August 2026 task release ... each as Pass@1 averaged over five independent runs.
官方材料
Claude Fable 5.1 and Claude Mythos 5.1 System Card · PDF 第 189 页
定位
附件 · 本地留存副本, PDF p.189
材料版本
PDF dated September 1, 2026; 212 pages. Full text review completed: pp.1-212. All 64 low-text or figure pages were rendered and visually inspected in 16 sheets; no additional standard Fable 5.1 capability scores were found in the supplementary safety/alignment sections. Revision date unknown. Local: 本地留存副本 and .txt.
版本公布
未确认
披露时间
未确认 · 首发/后补未确认
采集时间
历史依据
暂无可靠历史版本依据
引用文本

Claude Fable 5.1 · OSWorld(2.0,August 2026 task release(与此前 task files 不可直接比较)),Adaptive Max配置,Partial score 77.9%(具体成绩公布时间未确认);Claude Fable 5.1 · OSWorld(2.0,August 2026 task release(与此前 task files 不可直接比较)),Adaptive Max配置,Strict pass rate 41.7%(具体成绩公布时间未确认)。官方出处 Claude Fable 5.1 and Claude Mythos 5.1 System Card(附件,PDF dated September 1, 2026; 212 pages. Full text review completed: pp.1-212. All 64 low-text or figure pages were rendered and visually inspected in 16 sheets; no additional standard Fable 5.1 capability scores were found in the supplementary safety/alignment sections. Revision date unknown. Local: 本地留存副本 and .txt.)本地留存副本, PDF p.189,https://www.anthropic.com/claude-fable-5-1-mythos-5-1-system-card#page=189。Benchlog https://benchlog.lekshome.cc/evidence/claude-fable-and-mythos-5-1/ev-f51-card-osworld/

关联成绩与条件

Claude Fable 5.1 · OSWorld 成绩与配置
指标与成绩配置与评测条件证据关系
Partial score77.9%原文 77.9% partial · 单位 %
公布 未确认
Adaptive Max
设置
Claude Fable 5.1;CursorBench 主文引述明确为 max effort;后续 System Card 对 OSWorld/BenchCAD/OfficeQA 对照结果亦标 max effort。
未知项
不同 benchmark 的具体执行细节分别见来源章节;部分测试的采样参数或运行数未单独公布。
工具
工具条件未记录
推理预算
max
框架
未记录
协议
OSWorld 2.0 August 2026 task release with subsequent task fixes; 108 long-horizon tasks; 1080p; up to 500 actions/task; max effort; Pass@1 over five runs.
条件
Production safeguards enabled; tasks where safeguards intervened were completed by fallback models; not directly comparable with prior OSWorld 2.0 task releases.

直接支持该成绩

在排名中查看此成绩
Strict pass rate41.7%原文 41.7% strict · 单位 %
公布 未确认
Adaptive Max
设置
Claude Fable 5.1;CursorBench 主文引述明确为 max effort;后续 System Card 对 OSWorld/BenchCAD/OfficeQA 对照结果亦标 max effort。
未知项
不同 benchmark 的具体执行细节分别见来源章节;部分测试的采样参数或运行数未单独公布。
工具
工具条件未记录
推理预算
max
框架
未记录
协议
OSWorld 2.0 August 2026 task release with subsequent task fixes; 108 long-horizon tasks; 1080p; up to 500 actions/task; max effort; Pass@1 over five runs.
条件
Production safeguards enabled; tasks where safeguards intervened were completed by fallback models; not directly comparable with prior OSWorld 2.0 task releases.

直接支持该成绩

在排名中查看此成绩