Gemini API model id gemini-3-pro-preview; default sampling settings. Gemini results are pass@1 and single-attempt unless specified; smaller benchmarks average multiple trials.
未知项
The evaluation table does not specify a thinking budget or inference-time compute setting.
工具
禁止工具
推理预算
未记录
框架
未记录
协议
No tools; average of Standard (10 options) and Vision settings.
Gemini API model id gemini-3.1-pro-preview; default sampling settings; evaluation table column specifies Thinking (High). All scores are pass@1 except where noted.
未知项
Exact thinking budget and sampling parameters are not listed.
工具
禁止工具
推理预算
high
框架
未记录
协议
No tools; average of Standard (10 options) and Vision settings.
Differences are calculated only for unique, active, exact values between direct predecessors when the unit, metric, and explicitly recorded configuration and conditions match.
· 1 score record for this release, including 1 exact value (may include historical records)
Gemini 3 Pro · MMMU-Pro scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Accuracy81%Reported 81.0% · Unit %
Published Unconfirmed
Gemini 3 Pro API default
Settings
Gemini API model id gemini-3-pro-preview; default sampling settings. Gemini results are pass@1 and single-attempt unless specified; smaller benchmarks average multiple trials.
Unknowns
The evaluation table does not specify a thinking budget or inference-time compute setting.
Tools
Tools forbidden
Reasoning budget
not recorded
Framework
not recorded
Protocol
No tools; average of Standard (10 options) and Vision settings.
· 1 score record for this release, including 1 exact value (may include historical records)
Records for the direct predecessor do not provide matching conditions for a valid difference.
Gemini 3.1 Pro · MMMU-Pro scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
Accuracy80.5%Reported 80.5% · Unit %
Published Unconfirmed
Gemini 3.1 Pro Thinking (High)
Settings
Gemini API model id gemini-3.1-pro-preview; default sampling settings; evaluation table column specifies Thinking (High). All scores are pass@1 except where noted.
Unknowns
Exact thinking budget and sampling parameters are not listed.
Tools
Tools forbidden
Reasoning budget
high
Framework
not recorded
Protocol
No tools; average of Standard (10 options) and Vision settings.