Commit Graph

120 Commits

Author SHA1 Message Date
starmen1265 dfbbabceea docs(14-01): complete LLM call graceful degradation strategy
- 添加可恢复错误检测和重试逻辑
- 实现自动降级到规则分段
- 18 个测试全部通过
- 执行时间: 219s

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-23 22:39:02 +08:00
starmen1265 e4c704a582 docs(14-00): complete test infrastructure plan
- Create 14-00-SUMMARY.md documenting test infrastructure
- Update STATE.md with position and progress
- Update ROADMAP.md for Phase 14

Summary details:
- 26 tests created/modified covering ROBUST-01 to COST-03
- Test infrastructure ready for Phase 14 implementation plans
- TDD RED state established for unimplemented features
- 18 tests passing (existing functionality)
- 8 tests failing (expected - features not yet implemented)
2026-03-23 22:38:18 +08:00
starmen1265 bf359628fc docs(14-03): complete semantic cache implementation plan
- Created SUMMARY.md with implementation details
- Updated STATE.md with new decisions and session info
- Updated ROADMAP.md progress (1/6 plans complete)
- Marked COST-02 requirement complete

Duration: 1 min (72s)
Tasks: 1 (TDD: RED → GREEN)
Tests: 11 passed

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-23 22:36:50 +08:00
starmen1265 c378a0eb32 docs(14): set nyquist compliant 2026-03-23 22:34:19 +08:00
starmen1265 f8275a9846 docs(14): move plan 04 to wave 2 2026-03-23 22:33:53 +08:00
starmen1265 cefb79d311 docs(14): create phase 14 plans (5 plans + wave 0 tests) 2026-03-23 20:56:54 +08:00
starmen1265 3c9859c30d docs(14): add validation strategy 2026-03-23 20:54:44 +08:00
starmen1265 6d53ce47d4 docs(14): research phase 14 robustness and cost optimization 2026-03-23 20:53:52 +08:00
starmen1265 2dde3a3dc8 docs(14): capture phase context 2026-03-23 20:51:29 +08:00
starmen1265 e445986d6d docs(phase-13): complete phase execution 2026-03-22 00:34:15 +08:00
starmen1265 548bb35cef docs(13-07): complete SRTProcessor integration plan
- Create SUMMARY.md documenting SRTProcessor integration with LLM semantic segmentation
- Update STATE.md with completed plan position and performance metrics
- Update ROADMAP.md marking Phase 13 plans 01-07 as complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:33:01 +08:00
starmen1265 a6c0293c01 docs(13-06): complete extensible strategy architecture plan 2026-03-22 00:30:41 +08:00
starmen1265 35f8a78d13 docs(13-02): complete semantic boundary detection plan
完成计划 13-02 的执行和文档化:

功能验证:
- ✅ SEGMENTATION_PROMPT 包含话题转换检测指令
- ✅ extract_json_from_llm_response() 能处理多种格式
- ✅ _parse_result() 使用 Pydantic 验证 LLM 输出
- ✅ VideoSegment.start_index/end_index 验证 (ge=0)

测试覆盖:
- ✅ TestTopicBoundaryDetection (3 tests)
- ✅ TestJSONExtraction (4 tests)
- ✅ TestPydanticValidationExtended (2 tests)
- ✅ 所有 29 个测试通过

需求完成:
- ✅ BOUND-01: 话题转换点检测
- ✅ BOUND-02: 基于语义分析(非时间/字符)
- ✅ BOUND-03: 话题切换正确创建分段
- ✅ BOUND-04: 单个话题内容完整

文档:
- 创建 13-02-SUMMARY.md
- 更新 STATE.md (进度: 29%, 2/7 plans complete)
- 更新 ROADMAP.md
- 更新 REQUIREMENTS.md (标记 BOUND-* 为完成)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:27:57 +08:00
starmen1265 e9c60e0704 docs(13-01): complete plan summary
- 创建 13-01-SUMMARY.md 记录计划执行结果
- 记录 2 个 TDD 提交(RED + GREEN)
- 记录 3 个偏差(标题验证、Prompt 扩展、中文句边界测试)
- 所有测试通过(10个)
- 准备好进入计划 13-02

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:26:53 +08:00
starmen1265 fc1f457a7f docs(13-03): add self-check to SUMMARY.md 2026-03-22 00:26:50 +08:00
starmen1265 9dbb1a7026 docs(13-03): complete content completeness protection plan
- 创建 SUMMARY.md:内容完整性保护功能已完成
- 更新 STATE.md:进度 87% (33/38 plans)
- 更新 ROADMAP.md:Phase 13 进展中(3/7 summaries)
- 标记需求完成:COMP-01, COMP-02, COMP-03

完成内容:
- 添加内容完整性保护测试(6 个测试方法)
- 验证 SEGMENTATION_PROMPT 包含句边界和论点完整性指令
- 确认不包含并列结构特殊处理(符合用户决策)
- 所有 29 个测试通过

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:26:45 +08:00
starmen1265 9a34b7df5a docs(13-05): complete Chinese sentence boundary detection plan
- Created SUMMARY.md for plan 13-05
- Updated STATE.md with progress and metrics
- Updated ROADMAP.md with plan progress
- Marked requirements SENT-01, SENT-02, SENT-03 as complete
- Duration: 2 minutes, 1 task completed

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:26:23 +08:00
starmen1265 321b097492 docs(13-04): complete plan summary and state updates
- Create 13-04-SUMMARY.md with execution details
- Update STATE.md with position and performance metrics
- Update ROADMAP.md with plan progress (1/7 complete)
- Mark TITLE-01, TITLE-02, TITLE-03 requirements complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:25:37 +08:00
starmen1265 00319f523f feat(13-01): implement video type detection and Pydantic models
- 创建 SemanticSegmentationEngine 类
- 实现 VideoSegment 和 SegmentationResult Pydantic 模型
  - VideoSegment: title(可选), content(必填), start_index, end_index
  - SegmentationResult: video_type, segments[], actual_segment_count
  - 添加标题长度验证器(5-15字)
- 实现 _infer_video_type() 方法
  - 从元数据推断视频类型(知识类/故事类/访谈类/新闻类/vlog)
  - 支持从 title, category, tags 推断
  - 默认类型为"知识类"
- 实现 _build_prompt() 方法
  - 包含视频类型信息
  - 包含完整的分段要求(数量控制、句边界保护、标题生成等)
  - 包含 JSON 输出格式规范
- 添加 extract_json_from_llm_response() 工具函数
- 添加 AIClientProtocol 协议定义
- 添加 deferred-items.md 记录超出范围的测试

所有计划 13-01 测试通过(10个测试)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-22 00:25:21 +08:00
starmen1265 2bcaf05d52 docs(13): create phase 13 plan (7 plans) 2026-03-22 00:21:30 +08:00
starmen1265 da4b2d563a docs(13): research phase 13 LLM semantic segmentation 2026-03-22 00:19:23 +08:00
starmen1265 6ae74f423d docs(13): capture phase context 2026-03-22 00:14:06 +08:00
starmen1265 04f071b3bd docs(phase-12): complete phase execution - srt-simplifier
PR Test / lint (pull_request) Successful in 2s
2026-03-20 00:07:06 +08:00
starmen1265 a04d5c1ddb docs(12-02): complete Pipeline Integration plan
Phase 12 complete:
- B站视频使用 SRTProcessor 替代 AnalyzeProcessor
- Pipeline 平台路由逻辑实现
- 24 个测试全部通过
- DeepAnalyzer 添加弃用警告

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-19 23:48:30 +08:00
starmen1265 b312612e6c docs(12-01): complete SRT Processing Module plan
- Create 12-01-SUMMARY.md with implementation details
- Update STATE.md with current position (Phase 12, 50% complete)
- Update ROADMAP.md with plan progress
- Mark requirements SRT-01~04, OUT-01~02, OUT-04 as complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-19 23:41:13 +08:00
starmen1265 40337940d8 docs(12-02): fix autonomous flag for checkpoint task 2026-03-19 23:28:06 +08:00
starmen1265 56039c5956 docs(12-srt-simplifier): create phase 12 plans 2026-03-19 23:25:43 +08:00
starmen1265 fa46062698 chore: archive v1.4 milestone - clean up moved files
PR Test / lint (pull_request) Successful in 2s
- Delete .planning/REQUIREMENTS.md (archived to milestones/)
- Delete .planning/phases/11-stealth-fingerprinting/* (moved to milestones/v1.4-phases/)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-19 00:05:27 +08:00
starmen1265 679b7d1440 docs(phase-11): complete phase execution - stealth fingerprinting 2026-03-18 23:59:31 +08:00
starmen1265 b81eec4284 docs(11-02): complete stealth integration plan
- Created 11-02-SUMMARY.md with execution results
- Updated STATE.md: v1.4 milestone complete, 100% progress
- Updated ROADMAP.md: Phase 11 complete, all plans done
- Updated REQUIREMENTS.md: VERIFY-01, VERIFY-02 complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-18 23:56:09 +08:00
starmen1265 b9f74e5a7e docs(11-01): complete stealth fingerprint masking plan
- Created 11-01-SUMMARY.md with execution results
- Updated STATE.md: Plan 1/2 complete, 50% progress
- Updated ROADMAP.md: 11-01 marked complete
- Updated REQUIREMENTS.md: STEALTH-01 to STEALTH-04 complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-18 23:50:24 +08:00
starmen1265 d6026660a9 docs(11): create phase 11 stealth fingerprinting plans 2026-03-18 23:41:43 +08:00
starmen1265 bfb6ab9c0a docs(11): add validation strategy 2026-03-18 23:35:58 +08:00
starmen1265 76da0f04d4 docs(11): research stealth fingerprinting domain 2026-03-18 23:34:59 +08:00
starmen1265 2561de6ad7 docs: update research for v1.3 anti-crawler optimization
PR Test / lint (pull_request) Successful in 2s
- Add architecture research for proxy pool, behavior camouflage,
  captcha detection, and error recovery
- Update features, pitfalls, and stack documentation
- Add phase 10 validation checklist

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-18 20:45:14 +08:00
starmen1265 c30b0bce88 docs(phase-10): complete proxy pool phase execution 2026-03-18 16:55:18 +08:00
starmen1265 bcfef48676 docs(10-02): complete health check and crawler integration plan 2026-03-18 16:51:16 +08:00
starmen1265 96dfdce59c docs(10-01): complete proxy pool core plan
- SUMMARY.md: proxy pool infrastructure with round-robin rotation
- STATE.md: updated position to Plan 1 of 2
- ROADMAP.md: marked 10-01 complete
- REQUIREMENTS.md: marked PROXY-01, PROXY-02 complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-18 16:43:34 +08:00
starmen1265 e896bd6765 docs(10): create phase plan for proxy pool 2026-03-18 16:27:33 +08:00
starmen1265 fe22f94358 docs(10): research proxy pool domain 2026-03-18 16:18:38 +08:00
starmen1265 1b58bf9364 docs(10): capture phase context for proxy pool 2026-03-18 16:06:31 +08:00
starmen1265 7744f7ac1d docs(phase-09): complete phase execution - pipeline integration verified
PR Test / lint (pull_request) Successful in 2s
2026-03-17 23:25:08 +08:00
starmen1265 248a1f2b8c docs(09-01): complete ZhihuAdapter integration plan
- Integrated ZhihuCrawler into ZhihuAdapter
- Added comment crawling and formatting
- Implemented cookie auto-login flow
- Added idempotent execution via IdempotencyChecker

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 23:17:39 +08:00
starmen1265 22ed60a5ab docs(09-00): complete Wave 0 test scaffolding plan
- Added 5 mock fixtures for ZhihuCrawler integration testing
- Added 6 test skeletons (marked skip) for Wave 1 implementation
- Updated STATE.md with Phase 9 position
- Updated ROADMAP.md with plan progress

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 23:02:40 +08:00
starmen1265 bee696b96d docs(09): complete phase 9 planning with 2 plans in 2 waves 2026-03-17 22:54:48 +08:00
starmen1265 1c42443dce fix(09): revise plans based on checker feedback 2026-03-17 22:53:00 +08:00
starmen1265 ec18ea9197 docs(09): create phase 9 plans 2026-03-17 22:46:21 +08:00
starmen1265 45ba9c973f docs(09): research phase 9 domain 2026-03-17 22:37:38 +08:00
starmen1265 e6b62f42e7 docs(09): capture phase context 2026-03-17 22:32:44 +08:00
starmen1265 007b0d70ef docs(08): complete phase 08 - Zhihu Crawler
Phase 08: Crawler - All 3 plans complete

Verification: 7/7 must-haves passed
Tests: 44 passed

Requirements completed:
- CONT-01: Crawl Zhihu answers
- CONT-02: Crawl Zhihu articles
- CONT-03: Crawl comments (optional)
- CONT-04: Metadata extraction
- NET-01: Proxy configuration
- NET-02: Mandatory proxy
- NET-03: Rate limiting & retry

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 22:23:56 +08:00