docs(12-02): complete Pipeline Integration plan
Phase 12 complete: - B站视频使用 SRTProcessor 替代 AnalyzeProcessor - Pipeline 平台路由逻辑实现 - 24 个测试全部通过 - DeepAnalyzer 添加弃用警告 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -7,7 +7,7 @@
|
||||
- ✅ **v1.2 Zhihu Crawler** - Phases 7-9 (shipped 2026-03-17)
|
||||
- ✅ **v1.3 Proxy Pool** - Phase 10 (shipped 2026-03-18)
|
||||
- ✅ **v1.4 Zhihu Anti-Crawler** - Phase 11 (shipped 2026-03-18)
|
||||
- ◆ **v1.5 B站字幕简化处理** - Phase 12 (in progress)
|
||||
- ◆ **v1.5 B站字幕简化处理** - Phase 12 (shipped 2026-03-19)
|
||||
|
||||
## Phases
|
||||
|
||||
@@ -127,7 +127,7 @@ Plans:
|
||||
|
||||
---
|
||||
|
||||
## ◆ v1.5 B站字幕简化处理 (IN PROGRESS)
|
||||
## ✅ v1.5 B站字幕简化处理 (SHIPPED 2026-03-19)
|
||||
|
||||
**Milestone Goal:** 简化 B 站视频处理流程,基于 SRT 字幕生成易读的 Markdown 文档
|
||||
|
||||
@@ -144,11 +144,11 @@ Plans:
|
||||
6. 明显的语音识别错误已被 LLM 纠正
|
||||
7. DeepAnalyzer 相关代码已移除或禁用
|
||||
8. 知乎等其他平台处理器不受影响
|
||||
**Plans**: 2 plans (pending)
|
||||
**Plans**: 2 plans (all complete)
|
||||
|
||||
Plans:
|
||||
- [ ] 12-01-PLAN.md — SRT 处理模块(parser、segmenter、corrector)和 SRTProcessor 实现
|
||||
- [ ] 12-02-PLAN.md — Pipeline 集成、平台路由、测试验证
|
||||
- [x] 12-01-PLAN.md — SRT 处理模块(parser、segmenter、corrector)和 SRTProcessor 实现
|
||||
- [x] 12-02-PLAN.md — Pipeline 集成、平台路由、测试验证
|
||||
|
||||
**Key Decisions:**
|
||||
- SRT 处理模块独立于 DeepAnalyzer,位于 kb_workflow/srt/
|
||||
@@ -177,7 +177,7 @@ Phases execute in numeric order: 1 → 2 → ... → 10 → 11 → 12
|
||||
| 9. Pipeline 整合 | v1.2 | 1/1 | Complete | 2026-03-17 |
|
||||
| 10. Proxy Pool | v1.3 | 2/2 | Complete | 2026-03-18 |
|
||||
| 11. Stealth Fingerprinting | v1.4 | 2/2 | Complete | 2026-03-18 |
|
||||
| 12. SRT 简化处理器 | 1/2 | In Progress| | — |
|
||||
| 12. SRT 简化处理器 | v1.5 | 2/2 | Complete | 2026-03-19 |
|
||||
|
||||
---
|
||||
|
||||
|
||||
+12
-10
@@ -3,8 +3,8 @@ gsd_state_version: 1.0
|
||||
milestone: v1.5
|
||||
milestone_name: B站字幕简化处理
|
||||
status: in_progress
|
||||
last_updated: "2026-03-19T15:45:00.000Z"
|
||||
last_activity: 2026-03-19 — Completed 12-01 SRT Processing Module
|
||||
last_updated: "2026-03-19T15:57:00.000Z"
|
||||
last_activity: 2026-03-19 — Completed 12-02 Pipeline Integration
|
||||
---
|
||||
|
||||
# Project State
|
||||
@@ -14,16 +14,16 @@ last_activity: 2026-03-19 — Completed 12-01 SRT Processing Module
|
||||
See: .planning/PROJECT.md (updated 2026-03-19)
|
||||
|
||||
**Core value:** 可靠、可维护的处理管道 - 每个步骤独立、可验证、可恢复
|
||||
**Current focus:** Phase 12 - SRT 简化处理器
|
||||
**Current focus:** Phase 12 - SRT 简化处理器 (完成)
|
||||
|
||||
## Current Position
|
||||
|
||||
Phase: 12-srt-simplifier (1/2 plans complete)
|
||||
Plan: 12-02
|
||||
Status: In progress
|
||||
Last activity: 2026-03-19 — Completed 12-01 SRT Processing Module
|
||||
Phase: 12-srt-simplifier (2/2 plans complete)
|
||||
Plan: 12-02 (完成)
|
||||
Status: Phase 12 Complete
|
||||
Last activity: 2026-03-19 — Completed 12-02 Pipeline Integration
|
||||
|
||||
Progress: [█████░░░░░] 50%
|
||||
Progress: [██████████] 100%
|
||||
|
||||
## Accumulated Context
|
||||
|
||||
@@ -46,6 +46,8 @@ v1.5 Phase 12 decisions:
|
||||
- Lazy import for ASRCorrector to avoid dependency issues
|
||||
- Simple rule-based segmentation (no LLM) for speed
|
||||
- ASR correction is optional, fallback to original text
|
||||
- B站视频使用 SRTProcessor,其他平台保持 AnalyzeProcessor
|
||||
- Pipeline 平台路由:检测 platform=bilibili + content_type=video
|
||||
|
||||
### Blockers/Concerns
|
||||
|
||||
@@ -54,7 +56,7 @@ None.
|
||||
## Session Continuity
|
||||
|
||||
Last session: 2026-03-19
|
||||
Stopped at: Completed 12-01 SRT Processing Module
|
||||
Stopped at: Completed 12-02 Pipeline Integration
|
||||
Resume file: None
|
||||
|
||||
**Next step:** Execute 12-02 Pipeline Integration
|
||||
**Next step:** Phase 12 完成,可以继续下一里程碑任务
|
||||
|
||||
@@ -0,0 +1,101 @@
|
||||
---
|
||||
phase: 12-srt-simplifier
|
||||
plan: 02
|
||||
subsystem: pipeline
|
||||
tags: [srt, bilibili, pipeline, processor, platform-routing]
|
||||
|
||||
# Dependency graph
|
||||
requires:
|
||||
- phase: 12-01
|
||||
provides: SRTProcessor, SRT parser, segmenter, corrector
|
||||
provides:
|
||||
- B站视频简化处理流程(SRTProcessor 替代 AnalyzeProcessor)
|
||||
- Pipeline 平台路由逻辑
|
||||
- 端到端测试覆盖
|
||||
affects: [bilibili, pipeline, archive]
|
||||
|
||||
# Tech tracking
|
||||
tech-stack:
|
||||
added: []
|
||||
patterns: [platform-specific routing, conditional step execution]
|
||||
|
||||
key-files:
|
||||
created:
|
||||
- tests/test_bilibili_pipeline.py
|
||||
modified:
|
||||
- kb_workflow/pipeline/pipeline.py
|
||||
- kb_workflow/cli.py
|
||||
- kb_workflow/deep_analyzer/__init__.py
|
||||
|
||||
key-decisions:
|
||||
- "B站视频(platform=bilibili, content_type=video)使用 SRTProcessor"
|
||||
- "其他内容(知乎、B站文章)保持 AnalyzeProcessor"
|
||||
- "Pipeline 步骤顺序不变,条件判断决定执行哪个处理器"
|
||||
|
||||
patterns-established:
|
||||
- "Platform routing: 在 Pipeline.run() 中检测平台和内容类型,条件跳过步骤"
|
||||
- "Archive 处理器兼容两种输出: analysis_file (AnalyzeProcessor) 或 output_file (SRTProcessor)"
|
||||
|
||||
requirements-completed: [OUT-03, SCOPE-01, SCOPE-02]
|
||||
|
||||
# Metrics
|
||||
duration: 15min
|
||||
completed: 2026-03-19
|
||||
---
|
||||
|
||||
# Phase 12 Plan 02: Pipeline Integration Summary
|
||||
|
||||
**B站视频简化处理流程集成:Pipeline 平台路由逻辑,B站视频使用 SRTProcessor 替代 AnalyzeProcessor,其他平台保持不变**
|
||||
|
||||
## Performance
|
||||
|
||||
- **Duration:** 15 min
|
||||
- **Started:** 2026-03-19T15:42:16Z
|
||||
- **Completed:** 2026-03-19T15:57:00Z
|
||||
- **Tasks:** 4
|
||||
- **Files modified:** 4
|
||||
|
||||
## Accomplishments
|
||||
- Pipeline 支持平台特定处理流程,B站视频使用 SRTProcessor
|
||||
- CLI 处理器注册更新,包含 SRTProcessor
|
||||
- 端到端测试覆盖 B站视频、B站文章、知乎回答三种场景
|
||||
- DeepAnalyzer 添加弃用警告,提醒开发者 B站视频应使用 SRTProcessor
|
||||
|
||||
## Task Commits
|
||||
|
||||
Each task was committed atomically:
|
||||
|
||||
1. **Task 1: 修改 Pipeline 支持平台特定处理流程** - `8d41a1b` (feat)
|
||||
2. **Task 2: 更新 CLI 处理器注册** - `b3b6498` (feat)
|
||||
3. **Task 3: 添加 B 站视频流程的端到端测试** - `9870947` (test)
|
||||
4. **Task 4: 更新 DeepAnalyzer 添加弃用警告** - `a175a32` (fix)
|
||||
|
||||
## Files Created/Modified
|
||||
- `kb_workflow/pipeline/pipeline.py` - 添加 B站视频检测逻辑,跳过 analyze 使用 srt,添加 SRTInput 处理
|
||||
- `kb_workflow/cli.py` - 导入 SRTProcessor,更新处理器列表和步骤配置
|
||||
- `kb_workflow/deep_analyzer/__init__.py` - 添加弃用警告日志
|
||||
- `tests/test_bilibili_pipeline.py` - B站视频/文章、知乎回答端到端测试
|
||||
|
||||
## Decisions Made
|
||||
- B站视频(platform=bilibili, content_type=video)跳过 analyze 步骤,执行 srt 步骤
|
||||
- B站文章和知乎等内容跳过 srt 步骤,保持原有 analyze 流程
|
||||
- Archive 处理器从 analyze 或 srt 结果中获取输出文件路径
|
||||
|
||||
## Deviations from Plan
|
||||
|
||||
None - plan executed exactly as written.
|
||||
|
||||
## Issues Encountered
|
||||
None
|
||||
|
||||
## User Setup Required
|
||||
None - no external service configuration required.
|
||||
|
||||
## Next Phase Readiness
|
||||
- B站视频简化处理流程完整可用
|
||||
- 所有 24 个测试通过(test_srt_processor.py + test_bilibili_pipeline.py)
|
||||
- Phase 12 完成,可以继续下一阶段开发
|
||||
|
||||
---
|
||||
*Phase: 12-srt-simplifier*
|
||||
*Completed: 2026-03-19*
|
||||
Reference in New Issue
Block a user