Commit Graph

181 Commits

Author SHA1 Message Date
starmen1265 897ef95a87 docs(state): record phase 14 context session 2026-03-23 20:51:32 +08:00
starmen1265 2dde3a3dc8 docs(14): capture phase context 2026-03-23 20:51:29 +08:00
starmen1265 e445986d6d docs(phase-13): complete phase execution 2026-03-22 00:34:15 +08:00
starmen1265 548bb35cef docs(13-07): complete SRTProcessor integration plan
- Create SUMMARY.md documenting SRTProcessor integration with LLM semantic segmentation
- Update STATE.md with completed plan position and performance metrics
- Update ROADMAP.md marking Phase 13 plans 01-07 as complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:33:01 +08:00
starmen1265 a6c0293c01 docs(13-06): complete extensible strategy architecture plan 2026-03-22 00:30:41 +08:00
starmen1265 35f8a78d13 docs(13-02): complete semantic boundary detection plan
完成计划 13-02 的执行和文档化:

功能验证:
- ✅ SEGMENTATION_PROMPT 包含话题转换检测指令
- ✅ extract_json_from_llm_response() 能处理多种格式
- ✅ _parse_result() 使用 Pydantic 验证 LLM 输出
- ✅ VideoSegment.start_index/end_index 验证 (ge=0)

测试覆盖:
- ✅ TestTopicBoundaryDetection (3 tests)
- ✅ TestJSONExtraction (4 tests)
- ✅ TestPydanticValidationExtended (2 tests)
- ✅ 所有 29 个测试通过

需求完成:
- ✅ BOUND-01: 话题转换点检测
- ✅ BOUND-02: 基于语义分析(非时间/字符)
- ✅ BOUND-03: 话题切换正确创建分段
- ✅ BOUND-04: 单个话题内容完整

文档:
- 创建 13-02-SUMMARY.md
- 更新 STATE.md (进度: 29%, 2/7 plans complete)
- 更新 ROADMAP.md
- 更新 REQUIREMENTS.md (标记 BOUND-* 为完成)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:27:57 +08:00
starmen1265 20a80fcb04 docs(13-01): update state, roadmap, and requirements
- 更新 STATE.md 记录执行指标和决策
- 添加 5 个关键决策到 Accumulated Context
- 更新 ROADMAP.md 进度(计划 13-01 完成)
- 标记 VIDEO-01, VIDEO-02, VIDEO-03 为已完成
- 记录会话信息:完成 Phase 13 Plan 01

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:27:19 +08:00
starmen1265 e9c60e0704 docs(13-01): complete plan summary
- 创建 13-01-SUMMARY.md 记录计划执行结果
- 记录 2 个 TDD 提交(RED + GREEN)
- 记录 3 个偏差(标题验证、Prompt 扩展、中文句边界测试)
- 所有测试通过(10个)
- 准备好进入计划 13-02

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:26:53 +08:00
starmen1265 fc1f457a7f docs(13-03): add self-check to SUMMARY.md 2026-03-22 00:26:50 +08:00
starmen1265 9dbb1a7026 docs(13-03): complete content completeness protection plan
- 创建 SUMMARY.md:内容完整性保护功能已完成
- 更新 STATE.md:进度 87% (33/38 plans)
- 更新 ROADMAP.md:Phase 13 进展中(3/7 summaries)
- 标记需求完成:COMP-01, COMP-02, COMP-03

完成内容:
- 添加内容完整性保护测试(6 个测试方法)
- 验证 SEGMENTATION_PROMPT 包含句边界和论点完整性指令
- 确认不包含并列结构特殊处理(符合用户决策)
- 所有 29 个测试通过

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:26:45 +08:00
starmen1265 9a34b7df5a docs(13-05): complete Chinese sentence boundary detection plan
- Created SUMMARY.md for plan 13-05
- Updated STATE.md with progress and metrics
- Updated ROADMAP.md with plan progress
- Marked requirements SENT-01, SENT-02, SENT-03 as complete
- Duration: 2 minutes, 1 task completed

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:26:23 +08:00
starmen1265 321b097492 docs(13-04): complete plan summary and state updates
- Create 13-04-SUMMARY.md with execution details
- Update STATE.md with position and performance metrics
- Update ROADMAP.md with plan progress (1/7 complete)
- Mark TITLE-01, TITLE-02, TITLE-03 requirements complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:25:37 +08:00
starmen1265 00319f523f feat(13-01): implement video type detection and Pydantic models
- 创建 SemanticSegmentationEngine 类
- 实现 VideoSegment 和 SegmentationResult Pydantic 模型
  - VideoSegment: title(可选), content(必填), start_index, end_index
  - SegmentationResult: video_type, segments[], actual_segment_count
  - 添加标题长度验证器(5-15字)
- 实现 _infer_video_type() 方法
  - 从元数据推断视频类型(知识类/故事类/访谈类/新闻类/vlog)
  - 支持从 title, category, tags 推断
  - 默认类型为"知识类"
- 实现 _build_prompt() 方法
  - 包含视频类型信息
  - 包含完整的分段要求(数量控制、句边界保护、标题生成等)
  - 包含 JSON 输出格式规范
- 添加 extract_json_from_llm_response() 工具函数
- 添加 AIClientProtocol 协议定义
- 添加 deferred-items.md 记录超出范围的测试

所有计划 13-01 测试通过(10个测试)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:25:21 +08:00
starmen1265 47cd84b30a docs(state): record phase 13 planning complete 2026-03-22 00:21:40 +08:00
starmen1265 2bcaf05d52 docs(13): create phase 13 plan (7 plans) 2026-03-22 00:21:30 +08:00
starmen1265 da4b2d563a docs(13): research phase 13 LLM semantic segmentation 2026-03-22 00:19:23 +08:00
starmen1265 eecaccf288 docs(state): record phase 13 context session 2026-03-22 00:14:08 +08:00
starmen1265 6ae74f423d docs(13): capture phase context 2026-03-22 00:14:06 +08:00
starmen1265 ea2d6e4740 docs: create milestone v1.6 roadmap (3 phases, 30 requirements) 2026-03-22 00:02:53 +08:00
starmen1265 6279ab4268 docs: define milestone v1.6 requirements (30 requirements) 2026-03-21 23:58:15 +08:00
starmen1265 440c885448 docs: complete v1.6 semantic segmentation research 2026-03-21 23:53:55 +08:00
starmen1265 cf858027d4 docs: start milestone v1.6 语义分段改进 2026-03-21 23:43:58 +08:00
starmen1265 c8dcc3e09b chore: complete v1.5 milestone - B站字幕简化处理
PR Test / lint (pull_request) Successful in 2s
- Archive roadmap to milestones/v1.5-ROADMAP.md
- Archive requirements to milestones/v1.5-REQUIREMENTS.md
- Update ROADMAP.md with collapsed v1.5 entry
- Update PROJECT.md with validated requirements
- Add semantic segmentation to backlog

Delivered: B站视频简化处理流程

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-21 23:24:59 +08:00
starmen1265 d039537f1d docs(backlog): add semantic segmentation requirement
Add requirement for improving SRT semantic segmentation:
- Current rule-based approach cannot identify topic transitions
- Document 4 potential solutions with trade-offs
- Recommended approach: two-stage with optional LLM

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-21 23:20:19 +08:00
starmen1265 4d2645876b fix(srt): add disable_reasoning parameter for ASR correction and include title in archive filename
PR Test / lint (pull_request) Successful in 1s
- SimpleAIClient: Add disable_reasoning parameter to control AI thinking mode
- ASRCorrector: Use disable_reasoning=True to get direct correction results
- ArchiveProcessor: Extract title from frontmatter and include in filename

File naming format: {YYYYMMDD}_{content_id}_{title}_analysis.md

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-21 22:19:14 +08:00
starmen1265 9e007432eb docs: resolve debug deep-analyzer-wrong-output
PR Test / lint (pull_request) Successful in 3s
2026-03-21 21:41:30 +08:00
starmen1265 04f071b3bd docs(phase-12): complete phase execution - srt-simplifier
PR Test / lint (pull_request) Successful in 2s
2026-03-20 00:07:06 +08:00
starmen1265 a04d5c1ddb docs(12-02): complete Pipeline Integration plan
Phase 12 complete:
- B站视频使用 SRTProcessor 替代 AnalyzeProcessor
- Pipeline 平台路由逻辑实现
- 24 个测试全部通过
- DeepAnalyzer 添加弃用警告

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-19 23:48:30 +08:00
starmen1265 b312612e6c docs(12-01): complete SRT Processing Module plan
- Create 12-01-SUMMARY.md with implementation details
- Update STATE.md with current position (Phase 12, 50% complete)
- Update ROADMAP.md with plan progress
- Mark requirements SRT-01~04, OUT-01~02, OUT-04 as complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-19 23:41:13 +08:00
starmen1265 40337940d8 docs(12-02): fix autonomous flag for checkpoint task 2026-03-19 23:28:06 +08:00
starmen1265 56039c5956 docs(12-srt-simplifier): create phase 12 plans 2026-03-19 23:25:43 +08:00
starmen1265 978613461b docs: create milestone v1.5 requirements and roadmap 2026-03-19 23:18:50 +08:00
starmen1265 d69b85cb1e docs: start milestone v1.5 B站字幕简化处理 2026-03-19 23:13:43 +08:00
starmen1265 fa46062698 chore: archive v1.4 milestone - clean up moved files
PR Test / lint (pull_request) Successful in 2s
- Delete .planning/REQUIREMENTS.md (archived to milestones/)
- Delete .planning/phases/11-stealth-fingerprinting/* (moved to milestones/v1.4-phases/)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-19 00:05:27 +08:00
starmen1265 0e558d2e3d chore: archive v1.4 phase directories 2026-03-19 00:05:03 +08:00
starmen1265 a58fbfb4a7 chore: complete v1.4 Zhihu Anti-Crawler milestone 2026-03-19 00:04:04 +08:00
starmen1265 679b7d1440 docs(phase-11): complete phase execution - stealth fingerprinting 2026-03-18 23:59:31 +08:00
starmen1265 b81eec4284 docs(11-02): complete stealth integration plan
- Created 11-02-SUMMARY.md with execution results
- Updated STATE.md: v1.4 milestone complete, 100% progress
- Updated ROADMAP.md: Phase 11 complete, all plans done
- Updated REQUIREMENTS.md: VERIFY-01, VERIFY-02 complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-18 23:56:09 +08:00
starmen1265 b9f74e5a7e docs(11-01): complete stealth fingerprint masking plan
- Created 11-01-SUMMARY.md with execution results
- Updated STATE.md: Plan 1/2 complete, 50% progress
- Updated ROADMAP.md: 11-01 marked complete
- Updated REQUIREMENTS.md: STEALTH-01 to STEALTH-04 complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-18 23:50:24 +08:00
starmen1265 d6026660a9 docs(11): create phase 11 stealth fingerprinting plans 2026-03-18 23:41:43 +08:00
starmen1265 bfb6ab9c0a docs(11): add validation strategy 2026-03-18 23:35:58 +08:00
starmen1265 76da0f04d4 docs(11): research stealth fingerprinting domain 2026-03-18 23:34:59 +08:00
starmen1265 9e30e042a8 docs: create v1.4 Zhihu Anti-Crawler roadmap (1 phase, 2 plans) 2026-03-18 23:19:25 +08:00
starmen1265 eb90773422 docs: define v1.4 Zhihu Anti-Crawler requirements 2026-03-18 23:16:35 +08:00
starmen1265 a443cbde73 docs: start milestone v1.4 Zhihu Anti-Crawler 2026-03-18 23:09:06 +08:00
starmen1265 a9ead75da7 chore: complete v1.3 Proxy Pool milestone 2026-03-18 22:45:17 +08:00
starmen1265 d92b872b6c chore: remove phase 11 (Platform Adaptation) 2026-03-18 22:39:29 +08:00
starmen1265 d7f32b6b93 chore: remove phases 11-13 (Behavior Camouflage, CAPTCHA Detection, Error Recovery) 2026-03-18 22:35:48 +08:00
starmen1265 2561de6ad7 docs: update research for v1.3 anti-crawler optimization
PR Test / lint (pull_request) Successful in 2s
- Add architecture research for proxy pool, behavior camouflage,
  captcha detection, and error recovery
- Update features, pitfalls, and stack documentation
- Add phase 10 validation checklist

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-18 20:45:14 +08:00
starmen1265 0c63503309 docs: resolve debug kb_workflow-module-conflict 2026-03-18 20:38:30 +08:00