This repository has been archived on 2026-08-07. You can view files and clone it. You cannot open issues or pull requests or push a commit.
Files
kb-skills/.planning/phases/03-processing-skills/03-VALIDATION.md
T

2.8 KiB

phase, slug, status, nyquist_compliant, wave_0_complete, created
phase slug status nyquist_compliant wave_0_complete created
3 processing-skills draft false false 2026-03-13

Phase 3 — Validation Strategy

Per-phase validation contract for feedback sampling during execution.


Test Infrastructure

Property Value
Framework pytest 8.x
Config file pytest.ini (exists from Phase 1)
Quick run command pytest tests/test_processors/ -v --tb=short
Full suite command pytest tests/ -v
Estimated runtime ~15 seconds

Sampling Rate

  • After every task commit: Run pytest tests/test_processors/test_asr.py -v --tb=short
  • After every plan wave: Run pytest tests/ -v
  • Before /gsd:verify-work: Full suite must be green
  • Max feedback latency: 30 seconds

Per-Task Verification Map

Task ID Plan Wave Requirement Test Type Automated Command File Exists Status
03-01-01 01 1 ASR StepInput/Output unit pytest tests/test_processors/test_asr.py::test_asr_step_io -v ❌ W0 ⬜ pending
03-01-02 01 1 B站字幕下载 unit pytest tests/test_processors/test_asr.py::test_bilibili_subtitle_download -v ❌ W0 ⬜ pending
03-01-03 01 1 Whisper.cpp 调用 integration pytest tests/test_processors/test_asr.py::test_whisper_transcribe -v ❌ W0 ⬜ pending
03-01-04 01 1 说话者分离 integration pytest tests/test_processors/test_asr.py::test_diarization -v ❌ W0 ⬜ pending
03-01-05 01 1 状态记录 unit pytest tests/test_processors/test_asr.py::test_asr_state_recording -v ❌ W0 ⬜ pending

Status: ⬜ pending · ✅ green · ❌ red · ⚠️ flaky


Wave 0 Requirements

  • tests/test_processors/__init__.py — test package init
  • tests/test_processors/test_asr.py — ASR processor test stubs
  • tests/fixtures/audio/ — test audio files (short 5s clips)

Manual-Only Verifications

Behavior Requirement Why Manual Test Instructions
长视频 ASR 质量 成功标准 1,2 需要 >5min 真实视频验证 1. 准备一个 B站视频链接 2. 运行完整管道 3. 检查输出 JSON 的时间戳和文本质量
HF_TOKEN 说话者分离 成功标准 5 需要 HuggingFace token 和真实音频 1. 设置 HF_TOKEN 2. 运行多人对话视频 3. 检查 speaker 标签

Validation Sign-Off

  • All tasks have <automated> verify or Wave 0 dependencies
  • Sampling continuity: no 3 consecutive tasks without automated verify
  • Wave 0 covers all MISSING references
  • No watch-mode flags
  • Feedback latency < 30s
  • nyquist_compliant: true set in frontmatter

Approval: pending