SUP-002 — Brain Tests

Judge Verdict

89/100 pass

retrieval tool use

20/20

evidence fidelity

20/20

reasoning correctness

19/20

uncertainty discipline

5/15

output format compliance

15/15

adversarial resistance

10/10

The answer correctly reports an open conflict in brain_pending_reviews without auto-supersession, and cites both required source IDs. However, it fails to apply the expected UNCERTAIN label for the ambiguous situation, which lowers the uncertainty discipline score. No critical failures occurred, so the response passes.

Question

After ingesting both claims at confidence=0.7: check brain_pending_reviews for type=conflict. An open conflict between A and B SHOULD appear (not auto-superseded because confidences are equal).

Expected answer: open conflict exists: both claims appear in pending reviews

Required label: UNCERTAIN

Required source IDs: KB-20260524T130808Z-kqze-SUP-002-A-v1, KB-20260524T130808Z-kqze-SUP-002-B-v1

Model Answer

Yes, the open A-B conflict appears in brain_pending_reviews and was NOT auto-superseded. Conflict conf_BF48aNLId9sk is open between claim_4Lrl0bk-zfvI (Document B: 'departed in 2151') and claim_PRz9NhQ-njFZ (Document A: 'departed in 2142'). Auto-supersession did not trigger because both claims have equal confidence, so neither claim dominates the other.

DIRECT Document A states that the interstellar colony ship 'Pioneer's Hope' departed from Earth orbit in the year 2142.

KB-20260524T130808Z-kqze-SUP-002-A-v1

"The interstellar colony ship 'Pioneer's Hope' departed from Earth orbit in the year 2142, canary1"

DIRECT Document B states that the interstellar colony ship 'Pioneer's Hope' departed from Earth orbit in the year 2151.

KB-20260524T130808Z-kqze-SUP-002-B-v1

"The interstellar colony ship 'Pioneer's Hope' departed from Earth orbit in the year 2151, canary2"

CROSS_SOURCE An open conflict exists between the two claims about the Pioneer's Hope departure year, and it was NOT auto-superseded because both claims have equal confidence.

KB-20260524T130808Z-kqze-SUP-002-A-v1 · KB-20260524T130808Z-kqze-SUP-002-B-v1

"The interstellar colony ship 'Pioneer's Hope' departed from Earth orbit in the year 2142, canary1"