Gemini 2.5 Pro (GA) · LiveCodeBench(UI 2025-01-01 to 2025-05-01) 69% · 附件证据(card-livecodebench-ga)

Gemini 2.5 Pro (GA) 的 LiveCodeBench · UI 2025-01-01 to 2025-05-01 官方出处。Gemini 2.5 Pro stable API · 69%。见《Gemini 2.5 Pro Model Card》PDF p.5, Table 1, LiveCodeBench UI: 1/1/2025 - 5/1/2025, single attempt, Gemini 2.5 Pro (GA) column。证据 card-livecodebench-ga。

原文与定位

Gemini 2.5 Pro (GA) · LiveCodeBench(UI 2025-01-01 to 2025-05-01),Gemini 2.5 Pro stable API配置,Accuracy 69%(成绩公布 2025-06-17)。见《Gemini 2.5 Pro Model Card》PDF p.5, Table 1, LiveCodeBench UI: 1/1/2025 - 5/1/2025, single attempt, Gemini 2.5 Pro (GA) column。 查看成绩条件

Code generation / LiveCodeBench / UI: 1/1/2025 - 5/1/2025 | single attempt | 69.0%
官方材料
Gemini 2.5 Pro Model Card · PDF 第 5 页
定位
附件 · PDF p.5, Table 1, LiveCodeBench UI: 1/1/2025 - 5/1/2025, single attempt, Gemini 2.5 Pro (GA) column
材料版本
Last updated 2025-06-27; includes GA, Preview 05-06, and Experimental 03-25 columns
版本公布
披露时间
· 后补披露
采集时间
历史依据
暂无可靠历史版本依据
引用文本

Gemini 2.5 Pro (GA) · LiveCodeBench(UI 2025-01-01 to 2025-05-01),Gemini 2.5 Pro stable API配置,Accuracy 69%(成绩公布 2025-06-17)。官方出处 Gemini 2.5 Pro Model Card(附件,Last updated 2025-06-27; includes GA, Preview 05-06, and Experimental 03-25 columns)PDF p.5, Table 1, LiveCodeBench UI: 1/1/2025 - 5/1/2025, single attempt, Gemini 2.5 Pro (GA) column,https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-2-5-Pro-Model-Card.pdf#page=5。Benchlog https://benchlog.lekshome.cc/evidence/gemini-2-5-pro/card-livecodebench-ga/

关联成绩与条件

Gemini 2.5 Pro (GA) · LiveCodeBench 成绩与配置
指标与成绩配置与评测条件证据关系
Accuracy69%原文 69.0% · 单位 %
公布

结果冲突待核对,精确排名不采用。

Gemini 2.5 Pro stable API
设置
AI Studio API model id gemini-2.5-pro; default sampling settings. Technical report states Gemini scores are pass@1 and single-attempt unless specified. Aider Polyglot averages 3 trials; SWE-bench uses the internal agentic harness; Vibe-Eval uses Gemini as judge.
未知项
Thinking budget and any non-default settings for individual evaluations are not stated except where noted in each protocol.
工具
工具条件未记录
推理预算
未记录
框架
未记录
协议
Pass@1; technical report says LiveCodeBench results use UI range 2025-01-01 to 2025-05-01.
条件
Stable GA API model gemini-2.5-pro; launch-day technical report 69.0%, also printed in the June 27 GA model-card column. Current 73-page report gives 74.2% for the same UI range without explaining the revision; both retained with conflict=true.

直接支持该成绩

在排名中查看此成绩