DeepSeek-V3-Base · MBPP(DeepSeek-V3 Technical Report Table 3; MBPP (Pass@1); unit is not printed) 75.4 · 附件证据(ds-completion-v3-base-ev-018)

DeepSeek-V3-Base 的 MBPP · DeepSeek-V3 Technical Report Table 3; MBPP (Pass@1); unit is not printed 官方出处。DeepSeek-V3-Base · 75.4。见《DeepSeek-V3 Technical Report》PDF p.25; Table 3; full header and target row。证据 ds-completion-v3-base-ev-018。

原文与定位

DeepSeek-V3-Base · MBPP(DeepSeek-V3 Technical Report Table 3; MBPP (Pass@1); unit is not printed),DeepSeek-V3-Base配置,Pass@1 75.4(具体成绩公布时间未确认)。见《DeepSeek-V3 Technical Report》PDF p.25; Table 3; full header and target row。 查看成绩条件

Benchmark (Metric) | # Shots | DeepSeek-V2 Base | Qwen2.5 72B Base | LLaMA-3.1 405B Base | DeepSeek-V3 Base | MBPP (Pass@1) | 3-shot | 65.0 | 72.6 | 68.4 | 75.4 |
官方材料
DeepSeek-V3 Technical Report · PDF 第 25 页
定位
附件 · PDF p.25; Table 3; full header and target row
材料版本
Official arXiv technical report: 53/53 PDF pages read; Table 3 (V3-Base), Table 6 (V3 Chat), Table 7 and Table 8 integrated. Figures without exact labels were not estimated.
版本公布
未确认
披露时间
未确认 · 首发/后补未确认
采集时间
历史依据
暂无可靠历史版本依据
引用文本

DeepSeek-V3-Base · MBPP(DeepSeek-V3 Technical Report Table 3; MBPP (Pass@1); unit is not printed),DeepSeek-V3-Base配置,Pass@1 75.4(具体成绩公布时间未确认)。官方出处 DeepSeek-V3 Technical Report(附件,Official arXiv technical report: 53/53 PDF pages read; Table 3 (V3-Base), Table 6 (V3 Chat), Table 7 and Table 8 integrated. Figures without exact labels were not estimated.)PDF p.25; Table 3; full header and target row,https://arxiv.org/pdf/2412.19437#page=25。Benchlog https://benchlog.lekshome.cc/evidence/v3-base/ds-completion-v3-base-ev-018/

关联成绩与条件

DeepSeek-V3-Base · MBPP 成绩与配置
指标与成绩配置与评测条件证据关系
Pass@175.4原文 75.4 · 单位 未标注
公布 未确认
DeepSeek-V3-Base
设置
Base checkpoint, evaluated in the report's internal HAI-LLM framework with row-specific shot counts.
未知项
Do not merge with the V3 Chat model column.、The table does not print percent signs.
工具
工具条件未记录
推理预算
未记录
框架
HAI-LLM
协议
Official DeepSeek-V3 Technical Report Table 3; internal HAI-LLM framework; all listed models share the same evaluation setting.
条件
DeepSeek-V3 Base column; row-specific shot count retained. The table does not print a percent sign.

直接支持该成绩

在排名中查看此成绩