← All Test Cases

PER-001

v040 D person

critical

Repetitions

Documents

Questions

Reasoning

DETERMINISTIC

v040 D1 person tier min_credibility

📖 In Plain English

No description available yet for category "v040_D_person".

⚙️ How a single rep runs

① Generate

Model creates 0 synthetic documents and 0 questions with unique canary tokens

→ Fresh content per run prevents memorization and proves real retrieval

② Ingest (MCP)

Model calls brain_ingest to store the 0 documents

→ Tests the brain's storage and indexing pipeline

③ Query (MCP)

Model answers the question using brain retrieval tools (search, fetch, context_pack, etc.)

→ Core test — does the brain return correct evidence and let the model build a faithful answer?

④ Evaluate

Model judges the answer against ground truth (the document it generated in phase 1)

→ Produces a score 0–100 with detailed sub-scores (retrieval, fidelity, reasoning, etc.)

This rep is run 1 times per test run. A pass requires score ≥ 85 and no critical failures.

🔬 Technical Instructions (raw prompts sent to AI)

Recent Run History

0 runs

No runs have included this test yet.

📄 Raw YAML cases/v040_D_person/PER-001.yaml

schema_version: "1.0"
test_id: "PER-001"
category: "v040_D_person"
kind: "deterministic"
severity: "critical"
repetitions: 1
reasoning_type: "DETERMINISTIC"
num_documents: 0
num_questions: 0
tags: ["v040", "D1", "person", "tier", "min_credibility"]
assertion_module: "v040.D_person.per_001"
description: |
  brain_register_person(tier='lead') initializes credibility at tier.min_credibility (0.65) — NOT the midpoint.