Commit Graph

90 Commits

Author SHA1 Message Date
starmen1265 8d67f3c953 docs(06): complete phase 6 with verification passed
PR Test / lint (pull_request) Successful in 1s
- All 3 plans executed (06-01, 06-02, 06-03)
- sys.path operations eliminated
- Pipeline exported at package level
- Phase goal achieved: clean Python package structure

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:40:01 +08:00
starmen1265 2bec25e15c docs(06-03): complete gap closure plan 2026-03-17 00:37:30 +08:00
starmen1265 fdd6c08211 docs(06): create gap closure plan 06-03 2026-03-17 00:28:35 +08:00
starmen1265 3edbdcc183 docs(06): add phase verification report
PR Test / lint (pull_request) Successful in 2s
9/9 core functions verified, but gaps found:
- 4 remaining sys.path manipulations
- Pipeline not exported at package level

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:24:34 +08:00
starmen1265 190a04068b docs(06-02): complete pipeline module consolidation plan
- Move kb_pipeline/ to kb_workflow.pipeline/
- Update all imports to use absolute paths
- 278 tests pass (14 pre-existing failures unrelated to refactoring)
- CLI works with new module structure

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:18:06 +08:00
starmen1265 65fdf4646a docs(06-01): complete metadata consolidation plan 2026-03-17 00:08:09 +08:00
starmen1265 444ac22e44 docs(06): create phase 6 consolidation plans 2026-03-16 23:52:44 +08:00
starmen1265 5fc7000ef7 docs(06): add research and validation strategy 2026-03-16 23:47:46 +08:00
starmen1265 33acdf0c2e docs(phase-06): research code consolidation domain 2026-03-16 23:46:37 +08:00
starmen1265 24806adb90 docs(state): record phase 6 context session 2026-03-16 23:42:40 +08:00
starmen1265 9f4aee0ac7 docs(06): capture phase context 2026-03-16 23:42:31 +08:00
starmen1265 bee61f6e08 docs(phase-05): complete phase execution - archive-directory
- Phase 5 归档与目录优化完成
- 所有 11 个需求 (INT/ARC/OUT) 已验证通过
- 测试: 8 个归档相关测试通过

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 23:36:14 +08:00
starmen1265 ea672f4526 docs(05-03): complete archive testing plan
- Add SUMMARY.md with 8 tests (5 unit + 3 integration)
- Update STATE.md: Phase 5 complete, advance to Phase 6
- Mark requirements OUT-01, OUT-02, OUT-03, OUT-04 complete
- Document test patterns and decisions

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 23:31:47 +08:00
starmen1265 ccfa201250 fix(05-03): fix pre-existing test issues blocking verification
- Fix test_workflow_skips_completed_steps to mock _ask_rerun_step
- Fix test_fetch_video_metadata_success to use AsyncMock
- Document other pre-existing test issues in deferred-items.md

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 23:28:27 +08:00
starmen1265 bd5ffab6e7 docs(05-02): complete ArchiveProcessor implementation plan 2026-03-16 23:21:06 +08:00
starmen1265 129a6311f4 docs(05-01): complete unified intermediate directory plan
- Added intermediate_path config field with KB_INTERMEDIATE_PATH env var support
- Updated Pipeline to use configurable intermediate directory
- Updated CLI to default to intermediate_path instead of cwd
- Completed requirements: INT-01, INT-02, INT-03

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 23:16:09 +08:00
starmen1265 18bfb8886d docs(05): add INT-03 to Phase 5 requirements
- Update ROADMAP.md to include INT-03 (configurable intermediate path)
- Update 05-01 plan description to reflect INT-03 coverage

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 23:10:50 +08:00
starmen1265 ae69878b59 fix(05): revise plan to include KB_INTERMEDIATE_PATH config support
- Add INT-03 requirement to 05-01-PLAN.md requirements field
- Add Task 1 for KB_INTERMEDIATE_PATH config in KBSettings
- Update Task 2 and Task 3 to use configurable path instead of hardcoded
- Update 05-CONTEXT.md to reflect new decision (config support vs hardcoded)

Addresses checker issue: requirement_coverage for INT-03

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 23:08:27 +08:00
starmen1265 a11a2dde99 docs(05): create phase 5 plans for archive and directory optimization 2026-03-16 23:03:14 +08:00
starmen1265 c92ace8e2d docs(state): record phase 5 context session 2026-03-16 22:54:58 +08:00
starmen1265 2eff597c3b docs(05): capture phase context 2026-03-16 22:54:52 +08:00
starmen1265 0bc5bb7584 docs: create milestone v1.1 roadmap (2 phases) 2026-03-16 21:06:43 +08:00
starmen1265 90b5ec2a27 docs: define milestone v1.1 requirements 2026-03-16 20:58:59 +08:00
starmen1265 643acbf165 docs: start milestone v1.1 Architecture Refactor 2026-03-16 20:54:53 +08:00
starmen1265 f358c52578 fix(zhihu): 修复文章归档格式问题
PR Test / lint (pull_request) Successful in 1s
1. author 字段清理零宽度空格和换行符,修复 Obsidian 解析
2. 扩展 content_type 条件,answer/zhuanlan 使用文章模板
3. 读取 content.md 时去除 YAML frontmatter
4. generate_frontmatter 正确推断 platform 为 zhihu

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 18:19:42 +08:00
starmen1265 e288a16944 docs: resolve debug zhihu-article-images-missing 2026-03-16 17:49:31 +08:00
starmen1265 ae8f6080c9 删除就技能
PR Test / lint (pull_request) Successful in 2s
2026-03-16 16:55:21 +08:00
starmen1265 f98d649b5c docs: resolve debug kb-workflow-legacy-code-removal
PR Test / lint (pull_request) Successful in 1s
2026-03-16 15:27:57 +08:00
starmen1265 f05c93d2b1 fix(zhihu): remove noscript tags to prevent duplicate images
PR Test / lint (pull_request) Successful in 1s
Zhihu HTML structure includes noscript fallback images:
<figure><img data-actualsrc=...><noscript><img src=...></noscript></figure>

After fixing lazy-load (replacing src with data-actualsrc), both imgs
have real URLs, causing duplicates. The fix removes noscript tags before
processing img elements.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 15:08:08 +08:00
starmen1265 1239fed9a9 docs(debug): mark bilibili subtitle debug session as resolved
All fixes verified working:
- Video download for videos without official subtitles
- Whisper transcription with correct offset parsing
- Text extraction from Whisper JSON format
- End-to-end analysis with real video content

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 00:24:21 +08:00
starmen1265 c7cdd49f01 chore: add debug session and init file
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 00:09:16 +08:00
starmen1265 07a9db85f7 feat(download): add video download capability for videos without official subtitles
- When content_type is video and no official subtitle available:
  - Download video using yt-dlp
  - Extract audio for Whisper fallback
- Update content_file with actual video path

This enables the pipeline to handle videos that don't have
official Bilibili subtitles.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 00:09:16 +08:00
starmen1265 aae4d2fd70 docs(debug): resolve asyncio nested loop debug session
Root cause: BilibiliExtractor sync wrappers use asyncio.run() internally,
which fails when called from async context in BilibiliAdapter.

Fix: Call async methods directly instead of sync wrappers.

Verified: Human confirmed fix works (bilibili_BV16cNMzpExh)
2026-03-15 22:59:24 +08:00
starmen1265 46f7feb146 chore: complete v1.0 milestone
- Archive ROADMAP and REQUIREMENTS to milestones/
- Delete original ROADMAP.md and REQUIREMENTS.md
- Update PROJECT.md with v1.0 validated requirements
- Update STATE.md for milestone complete status
- Update MILESTONES.md with key accomplishments
- Add VERIFICATION.md for phase 04

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-15 00:59:18 +08:00
starmen1265 7cf6ddd02f chore: complete v1.0 milestone 2026-03-15 00:59:12 +08:00
starmen1265 5736e2228e docs(04-05): complete CLI process subcommand and E2E tests plan
- CLI 'process' subcommand for single-command workflow execution
- End-to-end integration tests (16 tests passing)
- State persistence and resumability verified

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-15 00:10:10 +08:00
starmen1265 f9f8ec84fc docs(04-04): complete Pipeline schemas and class plan 2026-03-13 23:39:49 +08:00
starmen1265 93c4f20044 docs(04-03): complete AnalyzeProcessor plan
- AnalyzeProcessor wraps DeepAnalyzer for AI-powered content analysis
- Analysis reports saved as Markdown with YAML frontmatter
- All 15 tests passing

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-13 23:34:52 +08:00
starmen1265 df4323af13 docs(04-02): complete DownloadProcessor plan 2026-03-13 23:25:27 +08:00
starmen1265 57e6d9b6b2 docs(04-01): complete BaseProcessor and ParseProcessor plan
- BaseProcessor abstract class with unified interface
- ParseProcessor wrapping LinkParser for URL parsing
- ParseInput/ParseOutput schemas for parse step
- All tests passing (18 tests)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-13 23:16:17 +08:00
starmen1265 747bb799ca docs(04): complete phase planning 2026-03-13 23:05:27 +08:00
starmen1265 0fd243c8e1 fix(04-05): revise plan based on checker feedback
Issues addressed:
1. Remove non-existent 04-06 from depends_on → [04-04] only
2. Add CLI 'process' subcommand implementation task (was missing)
3. Fix verify command syntax (pytest instead of malformed python -c)
4. Rewrite Task 2 action with proper test code structure

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-13 23:03:41 +08:00
starmen1265 bf44050392 docs(04): add validation strategy 2026-03-13 22:53:13 +08:00
starmen1265 4b4ed9cab6 docs(04-analysis-orchestration): create phase plans 2026-03-13 22:50:28 +08:00
starmen1265 debd53961a docs(04): research phase 04 domain 2026-03-13 22:43:32 +08:00
starmen1265 777fe38a9d docs(state): record phase 4 context session 2026-03-13 22:37:52 +08:00
starmen1265 62c33cdfd5 docs(04): capture phase context 2026-03-13 22:37:52 +08:00
starmen1265 6e4582f7ad docs(phase-03): complete phase execution 2026-03-13 19:39:56 +08:00
starmen1265 cb20090162 docs(03-01): complete ASr processing plan
- Created ASRInput/ASroputput schemas extending StepInput/StepOutput
- Implemented ASRProcessor with subtitle-first strategy
- Added Whisper.cpp integration with auto-cleanup
- Integrated speaker diarization (HF_TOKEN detection)
- All 22 tests passing
- Updated ROADMAP progress: Phase 3: 1/1 complete
- Updated state with completion timestamp and- Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-13 19:34:36 +08:00
starmen1265 d8f4df9149 docs(03-01): complete ASr processing plan
- Created ASRInput/ASroOutput schemas
- Implemented ASRProcessor with subtitle-first strategy
- Added whisper.cpp integration with auto-cleanup
- Integrated speaker diarization (HF_TOKEN detection)
- All 22 tests passing

- Updated ROADmap progress: Phase 3: 1/1 complete
- Updated state with completion timestamp

- recorded execution metrics

- Updated session info
- Added final documentation commit
2026-03-13 19:29:27 +08:00