DeepSeek-V3 · 官方评测披露
DeepSeek-V3 当前收录 34 项测试的官方记录。已完成列明材料的核查。
模型发布 · DeepSeek V3
官方材料与核查范围
All listed official model-card, official News/API, metadata and directly linked technical-report materials for this release were read through the requested scope. Tables without an explicit unit retain an empty unit; figures without exact labels were not estimated. 核对时间 。
当前资料不足以还原首发。 No reliable historical snapshot proving the complete launch-day material set was obtained. Official publication dates and current materials do not substitute for a launch snapshot.
- DeepSeek-V3 official Hugging Face model card · 主文 · HF revision e815299b0bcbac849fa540c768ef21845365c9eb; current card snapshot公布 未确认 · 采集 · 已核查 Official model-card Markdown read in full; benchmark rows, notes, configuration statements and linked reports checked.
- DeepSeek-V3 official Hugging Face model metadata · 主文 · author=deepseek-ai; repo createdAt=2024-12-25T12:52:23.000Z (repository upload time only); lastModified=2025-03-27T04:01:45.000Z; sha=e815299b0bcbac849fa540c768ef21845365c9eb公布 未确认 · 采集 · 已核查 Official model API metadata checked for author, repository identity, revision and timestamps; createdAt was never used as release date.
- DeepSeek-V3 正式发布 · 主文 · Official DeepSeek News index entry dated 2024-12-26; index downloaded and retained locally公布 · 采集 · 已核查 The official dated entry or current service table was read for this release scope; aliases were not treated as weight checkpoints.
- DeepSeek-V3 Technical Report · 附件 · Official arXiv technical report: 53/53 PDF pages read; Table 3 (V3-Base), Table 6 (V3 Chat), Table 7 and Table 8 integrated. Figures without exact labels were not estimated.公布 未确认 · 采集 · 已核查 Official arXiv technical report: 53/53 PDF pages read; Table 3 (V3-Base), Table 6 (V3 Chat), Table 7 and Table 8 integrated. Figures without exact labels were not estimated.
配置
- DeepSeek-V3 Chat · Chat checkpoint; source table limits output to 8K and repeats benchmarks under the card protocol. 输出上限 8192 tokens未知项 Exact temperature for each row is not stated in the table.
- DeepSeek-V3 RewardBench maj@6 · RewardBench self-feedback using majority voting across six samples as explicitly labeled maj@6. 未知项 No general effort tier; this configuration applies to the RewardBench maj@6 row.
直接前代与后续发布
当前收录未确认直接前代。 官方关系依据
测试记录 · 34
- MMLU-Pro · DeepSeek card version unspecified; Exact Match本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- GPQA Diamond · Diamond subset; task snapshot unspecified本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- LiveCodeBench · Version unspecified; Pass@1-CoT本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- Codeforces · Percentile; contest snapshot unspecified本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- SWE-bench Verified · Agent mode; task snapshot unspecified本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- AIME · 2024 edition; Pass@1本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- Aider-Polyglot · Version unspecified; Accuracy本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- MMLU · DeepSeek-V3 Technical Report Table 6; MMLU (EM); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- MMLU-Redux · DeepSeek-V3 Technical Report Table 6; MMLU-Redux (EM); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- DROP · DeepSeek-V3 Technical Report Table 6; DROP (3-shot F1); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- IF-Eval · DeepSeek-V3 Technical Report Table 6; IF-Eval (PromptStrict); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- SimpleQA · DeepSeek-V3 Technical Report Table 6; SimpleQA (Correct); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- FRAMES · DeepSeek-V3 Technical Report Table 6; FRAMES (Acc.); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- LongBench v2 · DeepSeek-V3 Technical Report Table 6; LongBench v2 (Acc.); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- HumanEval-Mul · DeepSeek-V3 Technical Report Table 6; HumanEval-Mul (Pass@1); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- LiveCodeBench · DeepSeek-V3 Technical Report Table 6; LiveCodeBench (Pass@1); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- Aider-Edit · DeepSeek-V3 Technical Report Table 6; Aider-Edit (Acc.); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- MATH-500 · DeepSeek-V3 Technical Report Table 6; MATH-500 (EM); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- CNMO · DeepSeek-V3 Technical Report Table 6; CNMO 2024 (Pass@1); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- CLUEWSC · DeepSeek-V3 Technical Report Table 6; CLUEWSC (EM); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- C-Eval · DeepSeek-V3 Technical Report Table 6; C-Eval (EM); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- C-SimpleQA · DeepSeek-V3 Technical Report Table 6; C-SimpleQA (Correct); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- Arena-Hard · DeepSeek-V3 Technical Report Table 7; Arena-Hard; unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- AlpacaEval 2.0 · DeepSeek-V3 Technical Report Table 7; AlpacaEval 2.0 (length-controlled win rate); unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- RewardBench · DeepSeek-V3 Technical Report Table 8; Chat; unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- RewardBench · DeepSeek-V3 Technical Report Table 8; Chat-Hard; unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- RewardBench · DeepSeek-V3 Technical Report Table 8; Safety; unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- RewardBench · DeepSeek-V3 Technical Report Table 8; Reasoning; unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- RewardBench · DeepSeek-V3 Technical Report Table 8; Average; unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- RewardBench · DeepSeek-V3 Technical Report Table 8; Chat; maj@6; unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- RewardBench · DeepSeek-V3 Technical Report Table 8; Chat-Hard; maj@6; unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- RewardBench · DeepSeek-V3 Technical Report Table 8; Safety; maj@6; unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- RewardBench · DeepSeek-V3 Technical Report Table 8; Reasoning; maj@6; unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)
- RewardBench · DeepSeek-V3 Technical Report Table 8; Average; maj@6; unit not printed本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)