New Survey Makes the Case for Agent-as-a-Judge: Why LLM Evaluators Fail on Hard Tasks

A research survey argues that simple LLM-as-a-Judge approaches break down on complex tasks like math, code, and medical reasoning — and proposes giving judge models access to tools and search to ground their evaluations.