kb-skills/.planning/phases/04-analysis-orchestration/04-VALIDATION.md

phase, slug, status, nyquist_compliant, wave_0_complete, created

phase	slug	status	nyquist_compliant	wave_0_complete	created
04	analysis-orchestration	draft	true	true	2026-03-13

Phase 4 — Validation Strategy

Per-phase validation contract for feedback sampling during execution.

---

Test Infrastructure

Property	Value
Framework	pytest 8.x
Config file	pytest.ini (exists)
Quick run command	pytest tests/unit -v --tb=short
Full suite command	pytest -v
Estimated runtime	~30 seconds

---

Sampling Rate

• After every task commit: Run pytest tests/unit -v --tb=short -x
• After every plan wave: Run pytest -v
• Before /gsd:verify-work: Full suite must be green
• Max feedback latency: 30 seconds

---

Per-Task Verification Map

Task ID	Plan	Wave	Requirement	Test Type	Automated Command	File Exists	Status
04-01-01	01	1	MNT-01	unit	pytest tests/test_processors/test_base.py -v	W0	pending
04-01-02	01	1	MNT-01	unit	pytest tests/test_processors/test_parse.py -v	W0	pending
04-02-01	02	2	MNT-01	unit	pytest tests/test_processors/test_download.py -v	W0	pending
04-03-01	03	3	MNT-01	unit	pytest tests/test_processors/test_analyze.py -v	W0	pending
04-04-01	04	4	MNT-01	unit	pytest tests/test_pipeline/test_pipeline.py -v	W0	pending
04-04-02	04	4	MNT-01	unit	pytest tests/test_cli/test_process_command.py -v	W0	pending
04-04-03	04	4	MNT-01	unit	pytest tests/test_pipeline/test_pipeline.py -v	W0	pending
04-04-04	04	5	MNT-01	unit	pytest tests/test_cli/test_process_command.py -v	W0	pending
04-05-01	05	5	MNT-01	integration	pytest tests/test_integration/test_e2e_workflow.py -v	W0	pending
04-04-05	04	5	MNT-01	unit	pytest tests/test_cli/test_process_command.py -v	W0	pending

Status: pending - green - red - flaky

Wave 0 Requirements

Existing infrastructure covers all phase requirements:

• pytest.ini -- configured with pythonpath
• tests/conftest.py -- shared fixtures exist
• tests/test_processors/ -- directory exists for processor tests

---

Manual-Only Verifications

Behavior	Requirement	Why Manual	Test Instructions
AI analysis quality	MNT-01	Requires AI API call	Run kb-workflow process <url> and verify report quality
E2E with real URLs	MNT-01	Network dependent	Test with actual B站/知乎 URLs

---

Validation Sign-Off

• All tasks have <automated> verify or Wave 0 dependencies
• Sampling continuity: no 3 consecutive tasks without automated verify
• Wave 0 covers all MISSING references
• No watch-mode flags
• Feedback latency < 30s
• nyquist_compliant: true set in frontmatter

Approval: pending