docs(12-02): complete Pipeline Integration plan
Phase 12 complete: - B站视频使用 SRTProcessor 替代 AnalyzeProcessor - Pipeline 平台路由逻辑实现 - 24 个测试全部通过 - DeepAnalyzer 添加弃用警告 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
@@ -7,7 +7,7 @@
|
|||||||
- ✅ **v1.2 Zhihu Crawler** - Phases 7-9 (shipped 2026-03-17)
|
- ✅ **v1.2 Zhihu Crawler** - Phases 7-9 (shipped 2026-03-17)
|
||||||
- ✅ **v1.3 Proxy Pool** - Phase 10 (shipped 2026-03-18)
|
- ✅ **v1.3 Proxy Pool** - Phase 10 (shipped 2026-03-18)
|
||||||
- ✅ **v1.4 Zhihu Anti-Crawler** - Phase 11 (shipped 2026-03-18)
|
- ✅ **v1.4 Zhihu Anti-Crawler** - Phase 11 (shipped 2026-03-18)
|
||||||
- ◆ **v1.5 B站字幕简化处理** - Phase 12 (in progress)
|
- ◆ **v1.5 B站字幕简化处理** - Phase 12 (shipped 2026-03-19)
|
||||||
|
|
||||||
## Phases
|
## Phases
|
||||||
|
|
||||||
@@ -127,7 +127,7 @@ Plans:
|
|||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## ◆ v1.5 B站字幕简化处理 (IN PROGRESS)
|
## ✅ v1.5 B站字幕简化处理 (SHIPPED 2026-03-19)
|
||||||
|
|
||||||
**Milestone Goal:** 简化 B 站视频处理流程,基于 SRT 字幕生成易读的 Markdown 文档
|
**Milestone Goal:** 简化 B 站视频处理流程,基于 SRT 字幕生成易读的 Markdown 文档
|
||||||
|
|
||||||
@@ -144,11 +144,11 @@ Plans:
|
|||||||
6. 明显的语音识别错误已被 LLM 纠正
|
6. 明显的语音识别错误已被 LLM 纠正
|
||||||
7. DeepAnalyzer 相关代码已移除或禁用
|
7. DeepAnalyzer 相关代码已移除或禁用
|
||||||
8. 知乎等其他平台处理器不受影响
|
8. 知乎等其他平台处理器不受影响
|
||||||
**Plans**: 2 plans (pending)
|
**Plans**: 2 plans (all complete)
|
||||||
|
|
||||||
Plans:
|
Plans:
|
||||||
- [ ] 12-01-PLAN.md — SRT 处理模块(parser、segmenter、corrector)和 SRTProcessor 实现
|
- [x] 12-01-PLAN.md — SRT 处理模块(parser、segmenter、corrector)和 SRTProcessor 实现
|
||||||
- [ ] 12-02-PLAN.md — Pipeline 集成、平台路由、测试验证
|
- [x] 12-02-PLAN.md — Pipeline 集成、平台路由、测试验证
|
||||||
|
|
||||||
**Key Decisions:**
|
**Key Decisions:**
|
||||||
- SRT 处理模块独立于 DeepAnalyzer,位于 kb_workflow/srt/
|
- SRT 处理模块独立于 DeepAnalyzer,位于 kb_workflow/srt/
|
||||||
@@ -177,7 +177,7 @@ Phases execute in numeric order: 1 → 2 → ... → 10 → 11 → 12
|
|||||||
| 9. Pipeline 整合 | v1.2 | 1/1 | Complete | 2026-03-17 |
|
| 9. Pipeline 整合 | v1.2 | 1/1 | Complete | 2026-03-17 |
|
||||||
| 10. Proxy Pool | v1.3 | 2/2 | Complete | 2026-03-18 |
|
| 10. Proxy Pool | v1.3 | 2/2 | Complete | 2026-03-18 |
|
||||||
| 11. Stealth Fingerprinting | v1.4 | 2/2 | Complete | 2026-03-18 |
|
| 11. Stealth Fingerprinting | v1.4 | 2/2 | Complete | 2026-03-18 |
|
||||||
| 12. SRT 简化处理器 | 1/2 | In Progress| | — |
|
| 12. SRT 简化处理器 | v1.5 | 2/2 | Complete | 2026-03-19 |
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
|
|||||||
+12
-10
@@ -3,8 +3,8 @@ gsd_state_version: 1.0
|
|||||||
milestone: v1.5
|
milestone: v1.5
|
||||||
milestone_name: B站字幕简化处理
|
milestone_name: B站字幕简化处理
|
||||||
status: in_progress
|
status: in_progress
|
||||||
last_updated: "2026-03-19T15:45:00.000Z"
|
last_updated: "2026-03-19T15:57:00.000Z"
|
||||||
last_activity: 2026-03-19 — Completed 12-01 SRT Processing Module
|
last_activity: 2026-03-19 — Completed 12-02 Pipeline Integration
|
||||||
---
|
---
|
||||||
|
|
||||||
# Project State
|
# Project State
|
||||||
@@ -14,16 +14,16 @@ last_activity: 2026-03-19 — Completed 12-01 SRT Processing Module
|
|||||||
See: .planning/PROJECT.md (updated 2026-03-19)
|
See: .planning/PROJECT.md (updated 2026-03-19)
|
||||||
|
|
||||||
**Core value:** 可靠、可维护的处理管道 - 每个步骤独立、可验证、可恢复
|
**Core value:** 可靠、可维护的处理管道 - 每个步骤独立、可验证、可恢复
|
||||||
**Current focus:** Phase 12 - SRT 简化处理器
|
**Current focus:** Phase 12 - SRT 简化处理器 (完成)
|
||||||
|
|
||||||
## Current Position
|
## Current Position
|
||||||
|
|
||||||
Phase: 12-srt-simplifier (1/2 plans complete)
|
Phase: 12-srt-simplifier (2/2 plans complete)
|
||||||
Plan: 12-02
|
Plan: 12-02 (完成)
|
||||||
Status: In progress
|
Status: Phase 12 Complete
|
||||||
Last activity: 2026-03-19 — Completed 12-01 SRT Processing Module
|
Last activity: 2026-03-19 — Completed 12-02 Pipeline Integration
|
||||||
|
|
||||||
Progress: [█████░░░░░] 50%
|
Progress: [██████████] 100%
|
||||||
|
|
||||||
## Accumulated Context
|
## Accumulated Context
|
||||||
|
|
||||||
@@ -46,6 +46,8 @@ v1.5 Phase 12 decisions:
|
|||||||
- Lazy import for ASRCorrector to avoid dependency issues
|
- Lazy import for ASRCorrector to avoid dependency issues
|
||||||
- Simple rule-based segmentation (no LLM) for speed
|
- Simple rule-based segmentation (no LLM) for speed
|
||||||
- ASR correction is optional, fallback to original text
|
- ASR correction is optional, fallback to original text
|
||||||
|
- B站视频使用 SRTProcessor,其他平台保持 AnalyzeProcessor
|
||||||
|
- Pipeline 平台路由:检测 platform=bilibili + content_type=video
|
||||||
|
|
||||||
### Blockers/Concerns
|
### Blockers/Concerns
|
||||||
|
|
||||||
@@ -54,7 +56,7 @@ None.
|
|||||||
## Session Continuity
|
## Session Continuity
|
||||||
|
|
||||||
Last session: 2026-03-19
|
Last session: 2026-03-19
|
||||||
Stopped at: Completed 12-01 SRT Processing Module
|
Stopped at: Completed 12-02 Pipeline Integration
|
||||||
Resume file: None
|
Resume file: None
|
||||||
|
|
||||||
**Next step:** Execute 12-02 Pipeline Integration
|
**Next step:** Phase 12 完成,可以继续下一里程碑任务
|
||||||
|
|||||||
@@ -0,0 +1,101 @@
|
|||||||
|
---
|
||||||
|
phase: 12-srt-simplifier
|
||||||
|
plan: 02
|
||||||
|
subsystem: pipeline
|
||||||
|
tags: [srt, bilibili, pipeline, processor, platform-routing]
|
||||||
|
|
||||||
|
# Dependency graph
|
||||||
|
requires:
|
||||||
|
- phase: 12-01
|
||||||
|
provides: SRTProcessor, SRT parser, segmenter, corrector
|
||||||
|
provides:
|
||||||
|
- B站视频简化处理流程(SRTProcessor 替代 AnalyzeProcessor)
|
||||||
|
- Pipeline 平台路由逻辑
|
||||||
|
- 端到端测试覆盖
|
||||||
|
affects: [bilibili, pipeline, archive]
|
||||||
|
|
||||||
|
# Tech tracking
|
||||||
|
tech-stack:
|
||||||
|
added: []
|
||||||
|
patterns: [platform-specific routing, conditional step execution]
|
||||||
|
|
||||||
|
key-files:
|
||||||
|
created:
|
||||||
|
- tests/test_bilibili_pipeline.py
|
||||||
|
modified:
|
||||||
|
- kb_workflow/pipeline/pipeline.py
|
||||||
|
- kb_workflow/cli.py
|
||||||
|
- kb_workflow/deep_analyzer/__init__.py
|
||||||
|
|
||||||
|
key-decisions:
|
||||||
|
- "B站视频(platform=bilibili, content_type=video)使用 SRTProcessor"
|
||||||
|
- "其他内容(知乎、B站文章)保持 AnalyzeProcessor"
|
||||||
|
- "Pipeline 步骤顺序不变,条件判断决定执行哪个处理器"
|
||||||
|
|
||||||
|
patterns-established:
|
||||||
|
- "Platform routing: 在 Pipeline.run() 中检测平台和内容类型,条件跳过步骤"
|
||||||
|
- "Archive 处理器兼容两种输出: analysis_file (AnalyzeProcessor) 或 output_file (SRTProcessor)"
|
||||||
|
|
||||||
|
requirements-completed: [OUT-03, SCOPE-01, SCOPE-02]
|
||||||
|
|
||||||
|
# Metrics
|
||||||
|
duration: 15min
|
||||||
|
completed: 2026-03-19
|
||||||
|
---
|
||||||
|
|
||||||
|
# Phase 12 Plan 02: Pipeline Integration Summary
|
||||||
|
|
||||||
|
**B站视频简化处理流程集成:Pipeline 平台路由逻辑,B站视频使用 SRTProcessor 替代 AnalyzeProcessor,其他平台保持不变**
|
||||||
|
|
||||||
|
## Performance
|
||||||
|
|
||||||
|
- **Duration:** 15 min
|
||||||
|
- **Started:** 2026-03-19T15:42:16Z
|
||||||
|
- **Completed:** 2026-03-19T15:57:00Z
|
||||||
|
- **Tasks:** 4
|
||||||
|
- **Files modified:** 4
|
||||||
|
|
||||||
|
## Accomplishments
|
||||||
|
- Pipeline 支持平台特定处理流程,B站视频使用 SRTProcessor
|
||||||
|
- CLI 处理器注册更新,包含 SRTProcessor
|
||||||
|
- 端到端测试覆盖 B站视频、B站文章、知乎回答三种场景
|
||||||
|
- DeepAnalyzer 添加弃用警告,提醒开发者 B站视频应使用 SRTProcessor
|
||||||
|
|
||||||
|
## Task Commits
|
||||||
|
|
||||||
|
Each task was committed atomically:
|
||||||
|
|
||||||
|
1. **Task 1: 修改 Pipeline 支持平台特定处理流程** - `8d41a1b` (feat)
|
||||||
|
2. **Task 2: 更新 CLI 处理器注册** - `b3b6498` (feat)
|
||||||
|
3. **Task 3: 添加 B 站视频流程的端到端测试** - `9870947` (test)
|
||||||
|
4. **Task 4: 更新 DeepAnalyzer 添加弃用警告** - `a175a32` (fix)
|
||||||
|
|
||||||
|
## Files Created/Modified
|
||||||
|
- `kb_workflow/pipeline/pipeline.py` - 添加 B站视频检测逻辑,跳过 analyze 使用 srt,添加 SRTInput 处理
|
||||||
|
- `kb_workflow/cli.py` - 导入 SRTProcessor,更新处理器列表和步骤配置
|
||||||
|
- `kb_workflow/deep_analyzer/__init__.py` - 添加弃用警告日志
|
||||||
|
- `tests/test_bilibili_pipeline.py` - B站视频/文章、知乎回答端到端测试
|
||||||
|
|
||||||
|
## Decisions Made
|
||||||
|
- B站视频(platform=bilibili, content_type=video)跳过 analyze 步骤,执行 srt 步骤
|
||||||
|
- B站文章和知乎等内容跳过 srt 步骤,保持原有 analyze 流程
|
||||||
|
- Archive 处理器从 analyze 或 srt 结果中获取输出文件路径
|
||||||
|
|
||||||
|
## Deviations from Plan
|
||||||
|
|
||||||
|
None - plan executed exactly as written.
|
||||||
|
|
||||||
|
## Issues Encountered
|
||||||
|
None
|
||||||
|
|
||||||
|
## User Setup Required
|
||||||
|
None - no external service configuration required.
|
||||||
|
|
||||||
|
## Next Phase Readiness
|
||||||
|
- B站视频简化处理流程完整可用
|
||||||
|
- 所有 24 个测试通过(test_srt_processor.py + test_bilibili_pipeline.py)
|
||||||
|
- Phase 12 完成,可以继续下一阶段开发
|
||||||
|
|
||||||
|
---
|
||||||
|
*Phase: 12-srt-simplifier*
|
||||||
|
*Completed: 2026-03-19*
|
||||||
Reference in New Issue
Block a user