Commit Graph

448 Commits

Author SHA1 Message Date
starmen1265 af3536aa92 test(07-02): add failing tests for Cookie JSON parsing
- Test parse_json_cookies for Chrome Cookie Editor format
- Test domain filtering for zhihu.com
- Test empty array handling
- Test malformed JSON error handling
- Test file not found error handling

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 17:48:23 +08:00
starmen1265 d6a8690bc7 docs(07): add phase plans (3 plans, 2 waves) 2026-03-17 17:18:12 +08:00
starmen1265 14434df4eb docs(07): create phase 7 login auth plans 2026-03-17 17:15:30 +08:00
starmen1265 1d1f3309b2 docs(07): research phase domain - login auth system 2026-03-17 17:08:30 +08:00
starmen1265 58487b0fa3 docs(state): record phase 7 context session 2026-03-17 16:57:14 +08:00
starmen1265 87c7e50c4f docs(07): capture phase context 2026-03-17 16:57:02 +08:00
starmen1265 367b2816c4 docs: create milestone v1.2 roadmap (3 phases) 2026-03-17 16:31:17 +08:00
starmen1265 dcba34b643 docs: define milestone v1.2 requirements 2026-03-17 16:27:05 +08:00
starmen1265 9077a783e8 docs: start milestone v1.2 Zhihu Crawler 2026-03-17 16:16:38 +08:00
starmen1265 79cf9635c6 Merge pull request 'fix/ci-deploy-reset' (#25) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/25
2026-03-17 15:35:59 +08:00
starmen1265 c77a45ab0b chore: remove old kb-deep-analyzer directory
PR Test / lint (pull_request) Successful in 1s
Code has been integrated into kb_workflow/deep_analyzer package.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 15:31:18 +08:00
starmen1265 9fc52ffbdd refactor: integrate kb-deep-analyzer as kb_workflow.deep_analyzer package
- Move kb-deep-analyzer/deep_analyzer.py to kb_workflow/deep_analyzer/__init__.py
- Update analyze.py to import from kb_workflow.deep_analyzer directly
- Remove sys.path manipulation for external package
- DeepAnalyzer, SimpleAIClient, generate_frontmatter now available as:
  from kb_workflow.deep_analyzer import DeepAnalyzer, SimpleAIClient, generate_frontmatter

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 15:28:58 +08:00
starmen1265 14b3a3c4c1 fix(analyze): correct kb-deep-analyzer path calculation
- Add one more .parent to reach correct directory level
- Fixed path: /home/.../kb-skills/kb-deep-analyzer (was /home/.../kb-skills/kb_workflow/kb-deep-analyzer)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 15:14:22 +08:00
starmen1265 bc5e02249d Merge pull request 'feat(kb_workflow): add archive_file to process_command return value' (#24) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/24
2026-03-17 13:54:58 +08:00
starmen1265 244dea9371 feat(kb_workflow): add archive_file to process_command return value
PR Test / lint (pull_request) Successful in 2s
- Extract archive_file from pipeline results and include in response
- Allows callers to get the final archive path instead of only content_dir
- Fixes report display issue where content directory showed working dir instead of archive location

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 13:53:55 +08:00
starmen1265 36de6cf6dd Merge pull request 'fix(download): return author name instead of mid in _extract_author' (#23) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/23
2026-03-17 13:51:49 +08:00
starmen1265 ee0fc74378 fix(download): return author name instead of mid in _extract_author
PR Test / lint (pull_request) Successful in 1s
- Fix download processor to return actual author name (e.g. "HOLA小测佬")
  instead of B站用户ID (mid, e.g. "406636263")
- Add 5 test cases for author extraction logic
- Resolves report display issue where UP主名称 showed numeric ID

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 13:50:02 +08:00
starmen1265 23254afc49 Merge pull request 'fix(debug): resolve kb-pipeline import issue in skill directory' (#22) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/22
2026-03-17 11:18:24 +08:00
starmen1265 2dce679cca fix(debug): resolve kb-pipeline import issue in skill directory
PR Test / lint (pull_request) Successful in 2s
Root cause: ~/.openclaw/skills/kb-workflow/kb_workflow.py used old
import paths (kb_pipeline.*) after v1.1 refactor renamed package to
kb_workflow.pipeline

Fix applied to external skill directory:
- Updated imports from kb_pipeline.* to kb_workflow.pipeline.*
- Fixed project_root path calculation
- Updated SKILL.md documentation

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 11:01:33 +08:00
starmen1265 00b8e103c0 Merge pull request 'fix/ci-deploy-reset' (#21) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/21
2026-03-17 00:41:46 +08:00
starmen1265 8d67f3c953 docs(06): complete phase 6 with verification passed
PR Test / lint (pull_request) Successful in 1s
- All 3 plans executed (06-01, 06-02, 06-03)
- sys.path operations eliminated
- Pipeline exported at package level
- Phase goal achieved: clean Python package structure

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:40:01 +08:00
starmen1265 2bec25e15c docs(06-03): complete gap closure plan 2026-03-17 00:37:30 +08:00
starmen1265 fae4ff2f28 fix(06-03): update test import to use new package structure
- Remove sys.path manipulation from test file
- Use standard package import from kb_workflow.metadata
- Test file now follows the same import pattern as production code

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:35:31 +08:00
starmen1265 72d75e3454 feat(06-03): export Pipeline class from pipeline package
- Add Pipeline import from kb_workflow.pipeline.pipeline
- Add Pipeline to __all__ exports list
- Enables: from kb_workflow.pipeline import Pipeline

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:34:26 +08:00
starmen1265 8b07ef9dcd refactor(06-03): move sys.path manipulation to lazy import in analyze.py
- Remove top-level sys.path.insert for kb-deep-analyzer
- Add module-level flag _deep_analyzer_path_added for single execution
- Move sys.path manipulation inside _run_analysis method
- External dependency import now happens lazily at runtime

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:34:06 +08:00
starmen1265 81d67b7672 fix(06-03): remove sys.path manipulation from zhihu_metadata.py
- Remove unnecessary sys.path.insert for current directory
- Use relative import for zhihu_extractor
- Package imports work correctly without path manipulation

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:33:23 +08:00
starmen1265 2b305b0eb9 fix(06-03): remove sys.path manipulation from zhihu_extractor.py
- Remove unnecessary sys.path.insert for current directory
- Use pure relative import for markdown_converter
- Package imports work correctly without path manipulation

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:33:02 +08:00
starmen1265 ab8655de3a fix(06-03): remove sys.path manipulation from kb_workflow.py
- Remove unnecessary sys.path.insert for project root
- Update docstring to reference kb_workflow.pipeline
- Package imports work correctly without path manipulation

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:32:40 +08:00
starmen1265 fdd6c08211 docs(06): create gap closure plan 06-03 2026-03-17 00:28:35 +08:00
starmen1265 7a1b2fc244 Merge pull request 'fix/ci-deploy-reset' (#20) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/20
2026-03-17 00:26:41 +08:00
starmen1265 3edbdcc183 docs(06): add phase verification report
PR Test / lint (pull_request) Successful in 2s
9/9 core functions verified, but gaps found:
- 4 remaining sys.path manipulations
- Pipeline not exported at package level

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:24:34 +08:00
starmen1265 190a04068b docs(06-02): complete pipeline module consolidation plan
- Move kb_pipeline/ to kb_workflow.pipeline/
- Update all imports to use absolute paths
- 278 tests pass (14 pre-existing failures unrelated to refactoring)
- CLI works with new module structure

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:18:06 +08:00
starmen1265 2df08c6e26 chore(06-02): remove original kb_pipeline directory
All code has been moved to kb_workflow.pipeline with updated imports.
278 tests pass (14 pre-existing mock-related failures unrelated to refactoring).

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:17:19 +08:00
starmen1265 c9ca1b538d refactor(06-02): update CLI and test imports to kb_workflow.pipeline
- Remove sys.path manipulation from kb_workflow.py
- Update CLI imports to use kb_workflow.pipeline prefix
- Update all test file imports and patch paths

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:17:10 +08:00
starmen1265 fdca690bd6 feat(06-02): move processors and platforms to kb_workflow.pipeline
- Move all processor implementations (parse, download, asr, analyze, archive)
- Move all platform adapters (base, bilibili, zhihu)
- Update all internal imports to use kb_workflow.pipeline prefix

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:17:01 +08:00
starmen1265 279ae684ea feat(06-02): move pipeline core files to kb_workflow.pipeline
- Move pipeline.py, schemas.py, config.py, state.py, errors.py
- Move retry.py, idempotency.py, link_parser.py
- Create pipeline/__init__.py with updated imports
- Update all internal imports to use kb_workflow.pipeline prefix

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:16:56 +08:00
starmen1265 65fdf4646a docs(06-01): complete metadata consolidation plan 2026-03-17 00:08:09 +08:00
starmen1265 766283366e refactor(06-01): delete original metadata directories and update tests
- Remove kb-bilibili-metadata/ and kb-zhihu-metadata/ directories
- Create kb_workflow/__init__.py to export main and process_command
- Update test_cli/test_process_command.py imports for new package structure

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:06:01 +08:00
starmen1265 98f8ec2e27 refactor(06-01): update platform adapters to use standard imports
- Remove sys.path manipulation from bilibili.py and zhihu.py
- Use standard imports from kb_workflow.metadata
- Remove try/except wrappers around imports

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 00:01:22 +08:00
starmen1265 a4a7454cd0 feat(06-01): move zhihu modules to metadata directory
- Move zhihu_extractor.py, zhihu_metadata.py, zhihu_article_crawler.py, markdown_converter.py
- Update metadata/__init__.py to export ZhihuPlaywrightExtractor

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 23:59:55 +08:00
starmen1265 e2edce2e29 feat(06-01): create metadata directory and move bilibili modules
- Rename kb-workflow to kb_workflow for Python package compatibility
- Move bilibili_extractor.py and bilibili_metadata.py to kb_workflow/metadata/
- Create metadata/__init__.py with BilibiliExporter export

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 23:59:23 +08:00
starmen1265 444ac22e44 docs(06): create phase 6 consolidation plans 2026-03-16 23:52:44 +08:00
starmen1265 5fc7000ef7 docs(06): add research and validation strategy 2026-03-16 23:47:46 +08:00
starmen1265 33acdf0c2e docs(phase-06): research code consolidation domain 2026-03-16 23:46:37 +08:00
starmen1265 24806adb90 docs(state): record phase 6 context session 2026-03-16 23:42:40 +08:00
starmen1265 9f4aee0ac7 docs(06): capture phase context 2026-03-16 23:42:31 +08:00
starmen1265 bee61f6e08 docs(phase-05): complete phase execution - archive-directory
- Phase 5 归档与目录优化完成
- 所有 11 个需求 (INT/ARC/OUT) 已验证通过
- 测试: 8 个归档相关测试通过

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 23:36:14 +08:00
starmen1265 ea672f4526 docs(05-03): complete archive testing plan
- Add SUMMARY.md with 8 tests (5 unit + 3 integration)
- Update STATE.md: Phase 5 complete, advance to Phase 6
- Mark requirements OUT-01, OUT-02, OUT-03, OUT-04 complete
- Document test patterns and decisions

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 23:31:47 +08:00
starmen1265 ccfa201250 fix(05-03): fix pre-existing test issues blocking verification
- Fix test_workflow_skips_completed_steps to mock _ask_rerun_step
- Fix test_fetch_video_metadata_success to use AsyncMock
- Document other pre-existing test issues in deferred-items.md

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 23:28:27 +08:00
starmen1265 360aee200f test(05-03): add Pipeline archive integration tests
- Test pipeline includes archive step
- Test archive uses platform directory structure
- Test no date-based subdirectories in archive
- Update default steps assertion to include archive

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 23:26:14 +08:00