Judge Verdict
100/100
pass
retrieval tool use
20/20
evidence fidelity
20/20
reasoning correctness
20/20
uncertainty discipline
15/15
output format compliance
15/15
adversarial resistance
10/10
The answer correctly identifies Extended Liability as the higher policy, states the difference as 150, cites both required sources, and uses the CROSS_SOURCE label appropriately on the comparison claim. All evidence quotes match the ground truth verbatim, no hallucinations or missing sources were found, and the output format is compliant. Score 100.
Question
Which policy has the higher limit, Standard Liability Policy or Extended Liability Policy? By how much?
Expected answer: Extended Liability Policy by 150
Required label: CROSS_SOURCE
Required source IDs:
KB-20260524T130808Z-kqze-NUM-001-A-v1, KB-20260524T130808Z-kqze-NUM-001-B-v1
Model Answer
Extended Liability Policy has the higher limit (300 vs 150), exceeding the Standard Liability Policy by 150.
DIRECT
Standard Liability Policy has a limit of 150.
KB-20260524T130808Z-kqze-NUM-001-A-v1
"Standard Liability Policy has a limit of 150."
DIRECT
Extended Liability Policy has a limit of 300.
KB-20260524T130808Z-kqze-NUM-001-B-v1
"Extended Liability Policy has a limit of 300."
CROSS_SOURCE
Extended Liability Policy has the higher limit compared to Standard Liability Policy.
KB-20260524T130808Z-kqze-NUM-001-A-v1 · KB-20260524T130808Z-kqze-NUM-001-B-v1
"Standard Liability Policy has a limit of 150."
CROSS_SOURCE
Extended Liability Policy's limit exceeds Standard Liability Policy's limit by 150.
KB-20260524T130808Z-kqze-NUM-001-A-v1 · KB-20260524T130808Z-kqze-NUM-001-B-v1
"Standard Liability Policy has a limit of 150."