ALI-002 — Brain Tests

Judge Verdict

99/100 pass

retrieval tool use

20/20

evidence fidelity

20/20

reasoning correctness

20/20

uncertainty discipline

15/15

output format compliance

14/15

adversarial resistance

10/10

The AI correctly performed the two-step procedure: it updated aliases, immediately searched using the new abbreviation 'aeth-cap', and returned the correct source ID and verbatim first sentence. All required source IDs and quotes match the ground truth. The only minor flaw is labeling the alias update claim as DIRECT instead of an action-based label, which is not a critical error.

Question

Step 1: Call brain_update_aliases to add 'aeth-cap' as an alias for 'Aetheric Capacitance Anomaly'. Step 2: Immediately search using only the abbreviation 'aeth-cap'. Return the source_id and first sentence of any document found.

Expected answer: The Aetheric Capacitance Anomaly (aeth-cap) occurs when plasma injections cause unexpected energy storage in the ship's conduits.

Required label: DIRECT

Required source IDs: KB-20260524T113756Z-kduj-ALI-002-A-v1

Model Answer

Source ID: KB-20260524T113756Z-kduj-ALI-002-A-v1. First sentence: "The Aetheric Capacitance Anomaly (aeth-cap) occurs when plasma injections cause unexpected energy storage in the ship's conduits."

DIRECT The alias 'aeth-cap' was successfully added as an alias for 'Aetheric Capacitance Anomaly'.

"Alias map updated. All future searches will automatically expand these terms."

DIRECT The source KB-20260524T113756Z-kduj-ALI-002-A-v1 contains a document titled 'Aetheric Capacitance Anomaly Research'.

KB-20260524T113756Z-kduj-ALI-002-A-v1

"Aetheric Capacitance Anomaly Research"

DIRECT The first sentence of the document states: 'The Aetheric Capacitance Anomaly (aeth-cap) occurs when plasma injections cause unexpected energy storage in the ship's conduits.'

KB-20260524T113756Z-kduj-ALI-002-A-v1

"The Aetheric Capacitance Anomaly (aeth-cap) occurs when plasma injections cause unexpected energy storage in the ship's conduits."