ExploitBench · GLM-5.3模型卡;unknown · 测试定义与成绩

ExploitBench · GLM-5.3模型卡;unknown 收录 1 次模型发布的评测披露或成绩。

测试版本与指标

别名 ExploitBench

  • coverage-score · 单位未标注 · 排序方向未确认

各系列最新模型 · 公布成绩

此测试使用完整公开配置。排名按指标与评测协议分组,已记录的工具、预算及框架分别展示。条件未说明的组保留公布值供查证。

coverage-score

允许工具 / max · 输出上限 128000 tokens / Claude Code 2.1.207 · The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **ExploitBench**: We evaluate GLM-5.3 in Claude Code 2.1.207 (max reasoning effort, no web tools with `temperature=1.0`, `top_p=1.0`, `max_new_tokens=128000`). Following the official evaluation settings, we limit the maximum number of interaction rounds between the agent and the environment to 300, and compute the average coverage score over all 41 tasks across 3 revisions. The coverage result of a task is determined by taking the union of capabilities achieved across all revisions, and the average score is obtained by averaging the results. We also apply a domain whitelist (allowing only essential domains such as pypi.org and deb.debian.org for basic tool installation) to prevent the agent from cheating.

ExploitBench · GLM-5.3模型卡;unknown · coverage-score · 允许工具 / max · 输出上限 128000 tokens / Claude Code 2.1.207 · The card says reasoning_effort defaults to max and recommends keeping that default for benchmark reproduction. **ExploitBench**: We evaluate GLM-5.3 in Claude Code 2.1.207 (max reasoning effort, no web tools with `temperature=1.0`, `top_p=1.0`, `max_new_tokens=128000`). Following the official evaluation settings, we limit the maximum number of interaction rounds between the agent and the environment to 300, and compute the average coverage score over all 41 tasks across 3 revisions. The coverage result of a task is determined by taking the union of capabilities achieved across all revisions, and the average score is obtained by averaging the results. We also apply a domain whitelist (allowing only essential domains such as pypi.org and deb.debian.org for basic tool installation) to prevent the agent from cheating.
模型与配置成绩记录与证据
GLM-5.3GLM-5.3 · max54.4

历史记录 · 1 次发布

  • GLM-5.3本次发布有 1 条成绩记录,含 1 条精确值(可含历史记录)