工具条件未记录 / max · 输出上限 64K tokens / Claude Code · The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **Agent's Last Exam (CLI)**: We evaluate ALE using the official evaluation protocol with the Claude Code harness (reasoning effort=max, 1M context, and 64K maximum output). Each of the 105 tasks runs in an isolated Docker container using the resources declared in its Task Card. The default timeout is 4 hours, with task-specific limits taking precedence (up to 8 hours). Tool Search is disabled, and results are scored by the official ALE evaluators.
Agents' Last Exam (ALE-CLI) · GLM-5.3模型卡;ALE-CLI · Reported score · 工具条件未记录 / max · 输出上限 64K tokens / Claude Code · The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **Agent's Last Exam (CLI)**: We evaluate ALE using the official evaluation protocol with the Claude Code harness (reasoning effort=max, 1M context, and 64K maximum output). Each of the 105 tasks runs in an isolated Docker container using the resources declared in its Task Card. The default timeout is 4 hours, with task-specific limits taking precedence (up to 8 hours). Tool Search is disabled, and results are scored by the official ALE evaluators.
Regular display scope. Rankings are grouped by metric and evaluation protocol. Recorded tool access, budgets, and frameworks are shown separately. Scores remain available for reference when conditions are unspecified.
Reported score
Tool access not recorded / max · Output limit 64K tokens / Claude Code · The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **Agent's Last Exam (CLI)**: We evaluate ALE using the official evaluation protocol with the Claude Code harness (reasoning effort=max, 1M context, and 64K maximum output). Each of the 105 tasks runs in an isolated Docker container using the resources declared in its Task Card. The default timeout is 4 hours, with task-specific limits taking precedence (up to 8 hours). Tool Search is disabled, and results are scored by the official ALE evaluators.
Agents' Last Exam (ALE-CLI) · GLM-5.3模型卡;ALE-CLI · Reported score · Tool access not recorded / max · Output limit 64K tokens / Claude Code · The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **Agent's Last Exam (CLI)**: We evaluate ALE using the official evaluation protocol with the Claude Code harness (reasoning effort=max, 1M context, and 64K maximum output). Each of the 105 tasks runs in an isolated Docker container using the resources declared in its Task Card. The default timeout is 4 hours, with task-specific limits taking precedence (up to 8 hours). Tool Search is disabled, and results are scored by the official ALE evaluators.