GLM-5.3 · ExploitBench · GLM-5.3模型卡;unknown · 成绩与配置

GLM-5.3 的 ExploitBench · GLM-5.3模型卡;unknown 记录。本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录),附 1 条来源定位。

成绩与评测条件

GLM-5.3 · ExploitBench 成绩与配置
指标与成绩配置与评测条件出处
coverage-score54.4原文 54.4 · 单位 未标注
公布 未确认
GLM-5.3 · max
设置
官方模型卡目标列;逐行scaffold、工具、采样及预算条件见protocol。来源把benchmark复现明确绑定max或行内明确reasoning_effort=max。
未知项
未逐项说明的指标单位、题集修订、服务精度和运行次数保持未知。
工具
允许工具
推理预算
max · 输出上限 128000 tokens
框架
Claude Code 2.1.207
协议
The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **ExploitBench**: We evaluate GLM-5.3 in Claude Code 2.1.207 (max reasoning effort, no web tools with `temperature=1.0`, `top_p=1.0`, `max_new_tokens=128000`). Following the official evaluation settings, we limit the maximum number of interaction rounds between the agent and the environment to 300, and compute the average coverage score over all 41 tasks across 3 revisions. The coverage result of a task is determined by taking the union of capabilities achieved across all revisions, and the average score is obtained by averaging the results. We also apply a domain whitelist (allowing only essential domains such as pypi.org and deb.debian.org for basic tool installation) to prevent the agent from cheating.
条件
GLM-5.3目标列;The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **ExploitBench**: We evaluate GLM-5.3 in Claude Code 2.1.207 (max reasoning effort, no web tools with `temperature=1.0`, `top_p=1.0`, `max_new_tokens=128000`). Following the official evaluation settings, we limit the maximum number of interaction rounds between the agent and the environment to 300, and compute the average coverage score over all 41 tasks across 3 revisions. The coverage result of a task is determined by taking the union of capabilities achieved across all revisions, and the average score is obtained by averaging the results. We also apply a domain whitelist (allowing only essential domains such as pypi.org and deb.debian.org for basic tool installation) to prevent the agent from cheating. 安全、内部子项或跨测试聚合仅保留原始披露,不进入常规展示。
在排名中查看此成绩

出处与披露

测试版本与指标

别名 ExploitBench

  • coverage-score · 单位未标注 · 排序方向未确认