Standard configuration: adaptive thinking, max effort
设置
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
未知项
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
工具
允许工具
推理预算
max
框架
未记录
协议
Legal Agent Benchmark public tasks, 1,235 problems after excluding 16 data defects; five runs.
条件
Adaptive thinking, max effort; pass requires all rubric criteria. Internal harness uses Sonnet 4.6 as judge and only bash and Python tools, versus more tools in the public harness.
Claude Sonnet 5 · Legal Agent Benchmark · Public full set · Scores and configurations
Claude Sonnet 5 record for Legal Agent Benchmark · Public full set. 2 score records for this release, including 2 exact values (may include historical records). Includes 1 source location.
Claude Sonnet 5 · Legal Agent Benchmark scores and configurations
Metric and score
Configuration and evaluation conditions
Sources
All-pass rate8.92%Reported 8.92% (±0.36, n=5) · Unit %
Published Unconfirmed
Standard configuration: adaptive thinking, max effort
Settings
Adaptive thinking at max effort; default temperature and top_p; five-trial averages unless otherwise stated.
Unknowns
Context-window size is evaluation-dependent; standard configuration is 1M tokens.
Tools
Tools allowed
Reasoning budget
max
Framework
not recorded
Protocol
Legal Agent Benchmark public tasks, 1,235 problems after excluding 16 data defects; five runs.
Conditions
Adaptive thinking, max effort; pass requires all rubric criteria. Internal harness uses Sonnet 4.6 as judge and only bash and Python tools, versus more tools in the public harness.