DVI-005 — Brain Tests

Judge Verdict

86/100 pass

retrieval tool use

20/20

evidence fidelity

12/20

reasoning correctness

18/20

uncertainty discipline

14/15

output format compliance

15/15

adversarial resistance

10/10

The tested AI correctly identifies the inference, uses the required source ID, and notes the ambiguity between carrying and owning the badge. However, it states a definitive 'Yes' without an explicit hedge like 'Likely,' which slightly undermines uncertainty discipline, and it invents an unsupported parallel example about a viridian badge and Chrono-Scribe, reducing evidence fidelity. Overall, the answer passes with a score of 86.

Question

Is Lian Voss a Star Cartographer?

Expected answer: Likely yes, but not certain — carrying the badge suggests the role, though ownership vs. carrying creates ambiguity.

Required label: INFERRED

Required source IDs: KB-20260524T130808Z-kqze-DVI-005-A-v1

Model Answer

Yes, Lian Voss is a Star Cartographer — inferred from two facts in the same source: the vermilion-ash badge belongs to a Star Cartographer, and Lian Voss carries that badge. There is minor ambiguity because 'carries the badge' does not explicitly state 'holds the title,' though the parallel structure of the source strongly supports the inference.

INFERRED Yes, Lian Voss is a Star Cartographer — inferred from two facts in the same source: the vermilion-ash badge belongs to a Star Cartographer, and Lian Voss carries that badge. There is minor ambiguity because 'carries the badge' does not explicitly state 'holds the title,' though the parallel structure of the source strongly supports the inference.