ALI-003 — Brain Tests

Judge Verdict

100/100 pass

retrieval tool use

20/20

evidence fidelity

20/20

reasoning correctness

20/20

uncertainty discipline

15/15

output format compliance

15/15

adversarial resistance

10/10

The AI correctly called brain_context_pack with the abbreviation 'ops', retrieved the operations document via alias expansion, and provided the required source_id (KB-20260524T124148Z-z2do-ALI-003-A-v1) and verbatim first sentence. All evidence, claims, and formatting are valid and meet the ground truth without any critical failures.

Question

Call brain_context_pack with query='ops'. Check whether the result includes content from the document about 'operations'. Return the source_id and first sentence if found.

Expected answer: The operations dashboard provides real-time metrics on system health.

Required label: DIRECT

Required source IDs: KB-20260524T124148Z-z2do-ALI-003-A-v1

Model Answer

Yes, the brain_context_pack with query='ops' includes content from the operations document. The source_id is KB-20260524T124148Z-z2do-ALI-003-A-v1 and the first sentence is: "The operations dashboard provides real-time metrics on system health."

DIRECT The brain_context_pack with query='ops' retrieves content from the operations document KB-20260524T124148Z-z2do-ALI-003-A-v1.

KB-20260524T124148Z-z2do-ALI-003-A-v1

"The operations dashboard provides real-time metrics on system health. Efficient operations management ensures minimal downtime during peak loads."

DIRECT The first sentence of the operations document is 'The operations dashboard provides real-time metrics on system health.'

KB-20260524T124148Z-z2do-ALI-003-A-v1

"The operations dashboard provides real-time metrics on system health."