docs(03): create ASR processing plan
This commit is contained in:
+9
-11
@@ -2,7 +2,7 @@
|
||||
|
||||
## Overview
|
||||
|
||||
将现有分散的技能模块重构为统一的管道处理系统。从基础设施(状态管理、Schema验证)开始,逐步集成平台技能(B站/知乎)、处理技能(ASR/OCR),最终形成完整的端到端工作流。每个阶段都交付可独立验证的能力,确保长时任务可恢复、可追溯。
|
||||
将现有分散的技能模块重构为统一的管道处理系统。从基础设施(状态管理、Schema验证)开始,逐步集成平台技能(B站/知乎)、处理技能(ASR),最终形成完整的端到端工作流。每个阶段都交付可独立验证的能力,确保长时任务可恢复、可追溯。
|
||||
|
||||
## Phases
|
||||
|
||||
@@ -14,7 +14,7 @@ Decimal phases appear between their surrounding integers in numeric order.
|
||||
|
||||
- [x] **Phase 1: Foundation** - 状态管理、Schema验证、错误处理、统一配置
|
||||
- [x] **Phase 2: Platform Skills** - B站/知乎链接解析、元数据提取、内容下载
|
||||
- [ ] **Phase 3: Processing Skills** - ASR/OCR集成、多模态内容处理
|
||||
- [ ] **Phase 3: Processing Skills** - ASR 集成、视频内容文字提取
|
||||
- [ ] **Phase 4: Analysis & Orchestration** - 深度分析集成、完整管道编排、端到端验证
|
||||
|
||||
## Phase Details
|
||||
@@ -54,20 +54,18 @@ Plans:
|
||||
- [x] 02-03-PLAN.md — Zhihu Adapter: 问答 + 专栏内容 (PLAT-03)
|
||||
|
||||
### Phase 3: Processing Skills
|
||||
**Goal**: 集成ASR和OCR处理能力,支持视频和图片的多模态内容提取
|
||||
**Goal**: 集成 ASR 处理能力,支持视频内容的文字提取(官方字幕优先,无字幕时使用 Whisper.cpp)
|
||||
**Depends on**: Phase 2
|
||||
**Requirements**: None (平台支持已在Phase 2覆盖)
|
||||
**Success Criteria** (what must be TRUE):
|
||||
1. B站视频自动下载字幕(优先官方字幕),无字幕时调用语音识别
|
||||
2. Whisper识别完成后,转录结果保存为结构化JSON(含时间戳)
|
||||
3. 视频帧自动提取并OCR识别,文字结果与时间戳关联
|
||||
4. 处理结果自动关联到对应的内容目录
|
||||
5. HF_TOKEN配置时自动启用带说话者分离的Whisper
|
||||
**Plans**: TBD
|
||||
3. 处理结果自动关联到对应的内容目录
|
||||
4. HF_TOKEN配置时自动启用带说话者分离的Whisper
|
||||
**Plans:** 1 plan
|
||||
|
||||
Plans:
|
||||
- [ ] 03-01: B站字幕下载 & Whisper/FunASR 集成
|
||||
- [ ] 03-02: OCR 处理集成
|
||||
- [ ] 03-01-PLAN.md — ASRProcessor: 官方字幕下载 + Whisper.cpp 集成 + 说话者分离
|
||||
|
||||
### Phase 4: Analysis & Orchestration
|
||||
**Goal**: 集成深度分析能力,完成端到端工作流编排,实现从链接到分析报告的全自动处理
|
||||
@@ -95,10 +93,10 @@ Phases execute in numeric order: 1 → 2 → 3 → 4
|
||||
|-------|----------------|--------|-----------|
|
||||
| 1. Foundation | 3/3 | Complete | 01-02, 01-01, 01-03 |
|
||||
| 2. Platform Skills | 3/3 | Complete | 02-01, 02-02, 02-03 |
|
||||
| 3. Processing Skills | 0/2 | Not started | - |
|
||||
| 3. Processing Skills | 0/1 | Not started | - |
|
||||
| 4. Analysis & Orchestration | 0/3 | Not started | - |
|
||||
|
||||
---
|
||||
*Roadmap created: 2026-03-13*
|
||||
*Last updated: 2026-03-13 - Phase 2 complete (3/3 plans)*
|
||||
*Last updated: 2026-03-13 - Phase 3 planned (OCR excluded per user decision)*
|
||||
*Granularity: coarse (4 phases)*
|
||||
|
||||
Reference in New Issue
Block a user