Harvey LAB-AA · Artificial Analysis v1.1; 120-task held-out set; hallucination-gated and ungated all-pass rates · Benchmark definition and scores
Harvey LAB-AA · Artificial Analysis v1.1; 120-task held-out set; hallucination-gated and ungated all-pass rates has benchmark disclosures or scores across 3 model releases.
Benchmark versions and metrics
Aliases Harvey LAB-AA v1.1
Hallucination-gated all-pass rate · % · Higher is better
All-pass rate before hallucination gate · % · Higher is better
Regular display scope. Rankings are grouped by metric and evaluation protocol. Recorded tool access, budgets, and frameworks are shown separately. Scores remain available for reference when conditions are unspecified.
Hallucination-gated all-pass rate %
Tool access not recorded / low / Framework not recorded · Conditions not specified
Harvey LAB-AA · Artificial Analysis v1.1; 120-task held-out set; hallucination-gated and ungated all-pass rates · Hallucination-gated all-pass rate · Tool access not recorded / low / Framework not recorded · Conditions not specified
Tool access not recorded / medium / Framework not recorded · Conditions not specified
Harvey LAB-AA · Artificial Analysis v1.1; 120-task held-out set; hallucination-gated and ungated all-pass rates · Hallucination-gated all-pass rate · Tool access not recorded / medium / Framework not recorded · Conditions not specified
Tool access not recorded / high / Framework not recorded · Conditions not specified
Harvey LAB-AA · Artificial Analysis v1.1; 120-task held-out set; hallucination-gated and ungated all-pass rates · Hallucination-gated all-pass rate · Tool access not recorded / high / Framework not recorded · Conditions not specified
Tool access not recorded / max / Framework not recorded · Conditions not specified
Harvey LAB-AA · Artificial Analysis v1.1; 120-task held-out set; hallucination-gated and ungated all-pass rates · Hallucination-gated all-pass rate · Tool access not recorded / max / Framework not recorded · Conditions not specified
Tool access not recorded / max / Framework not recorded · Harvey LAB-AA v1.1 held-out 120-task set; Artificial Analysis evaluation; max effort; average across three judge models.
Harvey LAB-AA · Artificial Analysis v1.1; 120-task held-out set; hallucination-gated and ungated all-pass rates · Hallucination-gated all-pass rate · Tool access not recorded / max / Framework not recorded · Harvey LAB-AA v1.1 held-out 120-task set; Artificial Analysis evaluation; max effort; average across three judge models.
Tool access not recorded / max / Framework not recorded · Harvey LAB-AA v1.1 held-out 120-task set; Artificial Analysis evaluation; max effort; average across three judge models.
Harvey LAB-AA · Artificial Analysis v1.1; 120-task held-out set; hallucination-gated and ungated all-pass rates · All-pass rate before hallucination gate · Tool access not recorded / max / Framework not recorded · Harvey LAB-AA v1.1 held-out 120-task set; Artificial Analysis evaluation; max effort; average across three judge models.