starmen1265/kb-skills
Archived
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
376 Commits 3 Branches 4 Tags
b9f74e5a7eb0dd95232004c4a972aa4698db1af0
Commit Graph

63 Commits

Author SHA1 Message Date
starmen1265 b9f74e5a7e docs(11-01): complete stealth fingerprint masking plan 
- Created 11-01-SUMMARY.md with execution results
- Updated STATE.md: Plan 1/2 complete, 50% progress
- Updated ROADMAP.md: 11-01 marked complete
- Updated REQUIREMENTS.md: STEALTH-01 to STEALTH-04 complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-18 23:50:24 +08:00
starmen1265 9e30e042a8 docs: create v1.4 Zhihu Anti-Crawler roadmap (1 phase, 2 plans) 2026-03-18 23:19:25 +08:00
starmen1265 a443cbde73 docs: start milestone v1.4 Zhihu Anti-Crawler 2026-03-18 23:09:06 +08:00
starmen1265 a9ead75da7 chore: complete v1.3 Proxy Pool milestone 2026-03-18 22:45:17 +08:00
starmen1265 d92b872b6c chore: remove phase 11 (Platform Adaptation) 2026-03-18 22:39:29 +08:00
starmen1265 d7f32b6b93 chore: remove phases 11-13 (Behavior Camouflage, CAPTCHA Detection, Error Recovery) 2026-03-18 22:35:48 +08:00
starmen1265 c30b0bce88 docs(phase-10): complete proxy pool phase execution 2026-03-18 16:55:18 +08:00
starmen1265 bcfef48676 docs(10-02): complete health check and crawler integration plan 2026-03-18 16:51:16 +08:00
starmen1265 96dfdce59c docs(10-01): complete proxy pool core plan 
- SUMMARY.md: proxy pool infrastructure with round-robin rotation
- STATE.md: updated position to Plan 1 of 2
- ROADMAP.md: marked 10-01 complete
- REQUIREMENTS.md: marked PROXY-01, PROXY-02 complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-18 16:43:34 +08:00
starmen1265 9d9de810b7 docs: create milestone v1.3 roadmap (5 phases) 2026-03-18 14:17:14 +08:00
starmen1265 e4f96be0c4 docs: start milestone v1.3 Anti-Crawler Optimization 2026-03-18 11:59:39 +08:00
starmen1265 7744f7ac1d docs(phase-09): complete phase execution - pipeline integration verified
PR Test / lint (pull_request) Successful in 2s
Details
2026-03-17 23:25:08 +08:00
starmen1265 248a1f2b8c docs(09-01): complete ZhihuAdapter integration plan 
- Integrated ZhihuCrawler into ZhihuAdapter
- Added comment crawling and formatting
- Implemented cookie auto-login flow
- Added idempotent execution via IdempotencyChecker

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-17 23:17:39 +08:00
starmen1265 22ed60a5ab docs(09-00): complete Wave 0 test scaffolding plan 
- Added 5 mock fixtures for ZhihuCrawler integration testing
- Added 6 test skeletons (marked skip) for Wave 1 implementation
- Updated STATE.md with Phase 9 position
- Updated ROADMAP.md with plan progress

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-17 23:02:40 +08:00
starmen1265 b3c7386098 docs(state): record phase 9 context session 2026-03-17 22:32:56 +08:00
starmen1265 007b0d70ef docs(08): complete phase 08 - Zhihu Crawler 
Phase 08: Crawler - All 3 plans complete

Verification: 7/7 must-haves passed
Tests: 44 passed

Requirements completed:
- CONT-01: Crawl Zhihu answers
- CONT-02: Crawl Zhihu articles
- CONT-03: Crawl comments (optional)
- CONT-04: Metadata extraction
- NET-01: Proxy configuration
- NET-02: Mandatory proxy
- NET-03: Rate limiting & retry

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-17 22:23:56 +08:00
starmen1265 6a4f13b2f6 docs(08-02): complete comment crawler plan 
- Add 08-02-SUMMARY.md with execution details
- Update STATE.md with decisions and metrics
- Mark CONT-03 requirement complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-17 21:59:49 +08:00
starmen1265 ba33e0e518 docs(state): record phase 08 context session 2026-03-17 18:57:06 +08:00
starmen1265 e8eaca519f docs(07-03): complete Login CLI Subcommand plan 
- Cookie validation via /api/v4/me endpoint
- login CLI subcommand with 3 modes: scan, import, status
- AUTH-04 requirement complete: Cookie expiry detection
- Phase 7 Login Auth complete, ready for Phase 8 Crawler

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-17 18:24:32 +08:00
starmen1265 4228b1e3a1 docs(07-01): complete QR Code Login Core plan 2026-03-17 17:57:28 +08:00
starmen1265 771ca554b3 docs(07-02): complete cookie import & persistence plan 2026-03-17 17:53:38 +08:00
starmen1265 58487b0fa3 docs(state): record phase 7 context session 2026-03-17 16:57:14 +08:00
starmen1265 367b2816c4 docs: create milestone v1.2 roadmap (3 phases) 2026-03-17 16:31:17 +08:00
starmen1265 9077a783e8 docs: start milestone v1.2 Zhihu Crawler 2026-03-17 16:16:38 +08:00
starmen1265 8d67f3c953 docs(06): complete phase 6 with verification passed
PR Test / lint (pull_request) Successful in 1s
Details 
- All 3 plans executed (06-01, 06-02, 06-03)
- sys.path operations eliminated
- Pipeline exported at package level
- Phase goal achieved: clean Python package structure

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-17 00:40:01 +08:00
starmen1265 2bec25e15c docs(06-03): complete gap closure plan 2026-03-17 00:37:30 +08:00
starmen1265 190a04068b docs(06-02): complete pipeline module consolidation plan 
- Move kb_pipeline/ to kb_workflow.pipeline/
- Update all imports to use absolute paths
- 278 tests pass (14 pre-existing failures unrelated to refactoring)
- CLI works with new module structure

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-17 00:18:06 +08:00
starmen1265 65fdf4646a docs(06-01): complete metadata consolidation plan 2026-03-17 00:08:09 +08:00
starmen1265 24806adb90 docs(state): record phase 6 context session 2026-03-16 23:42:40 +08:00
starmen1265 bee61f6e08 docs(phase-05): complete phase execution - archive-directory 
- Phase 5 归档与目录优化完成
- 所有 11 个需求 (INT/ARC/OUT) 已验证通过
- 测试: 8 个归档相关测试通过

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-16 23:36:14 +08:00
starmen1265 ea672f4526 docs(05-03): complete archive testing plan 
- Add SUMMARY.md with 8 tests (5 unit + 3 integration)
- Update STATE.md: Phase 5 complete, advance to Phase 6
- Mark requirements OUT-01, OUT-02, OUT-03, OUT-04 complete
- Document test patterns and decisions

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-16 23:31:47 +08:00
starmen1265 bd5ffab6e7 docs(05-02): complete ArchiveProcessor implementation plan 2026-03-16 23:21:06 +08:00
starmen1265 129a6311f4 docs(05-01): complete unified intermediate directory plan 
- Added intermediate_path config field with KB_INTERMEDIATE_PATH env var support
- Updated Pipeline to use configurable intermediate directory
- Updated CLI to default to intermediate_path instead of cwd
- Completed requirements: INT-01, INT-02, INT-03

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-16 23:16:09 +08:00
starmen1265 c92ace8e2d docs(state): record phase 5 context session 2026-03-16 22:54:58 +08:00
starmen1265 0bc5bb7584 docs: create milestone v1.1 roadmap (2 phases) 2026-03-16 21:06:43 +08:00
starmen1265 643acbf165 docs: start milestone v1.1 Architecture Refactor 2026-03-16 20:54:53 +08:00
starmen1265 7cf6ddd02f chore: complete v1.0 milestone 2026-03-15 00:59:12 +08:00
starmen1265 5736e2228e docs(04-05): complete CLI process subcommand and E2E tests plan 
- CLI 'process' subcommand for single-command workflow execution
- End-to-end integration tests (16 tests passing)
- State persistence and resumability verified

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-15 00:10:10 +08:00
starmen1265 f9f8ec84fc docs(04-04): complete Pipeline schemas and class plan 2026-03-13 23:39:49 +08:00
starmen1265 93c4f20044 docs(04-03): complete AnalyzeProcessor plan 
- AnalyzeProcessor wraps DeepAnalyzer for AI-powered content analysis
- Analysis reports saved as Markdown with YAML frontmatter
- All 15 tests passing

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-13 23:34:52 +08:00
starmen1265 df4323af13 docs(04-02): complete DownloadProcessor plan 2026-03-13 23:25:27 +08:00
starmen1265 57e6d9b6b2 docs(04-01): complete BaseProcessor and ParseProcessor plan 
- BaseProcessor abstract class with unified interface
- ParseProcessor wrapping LinkParser for URL parsing
- ParseInput/ParseOutput schemas for parse step
- All tests passing (18 tests)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-13 23:16:17 +08:00
starmen1265 777fe38a9d docs(state): record phase 4 context session 2026-03-13 22:37:52 +08:00
starmen1265 6e4582f7ad docs(phase-03): complete phase execution 2026-03-13 19:39:56 +08:00
starmen1265 cb20090162 docs(03-01): complete ASr processing plan 
- Created ASRInput/ASroputput schemas extending StepInput/StepOutput
- Implemented ASRProcessor with subtitle-first strategy
- Added Whisper.cpp integration with auto-cleanup
- Integrated speaker diarization (HF_TOKEN detection)
- All 22 tests passing
- Updated ROADMAP progress: Phase 3: 1/1 complete
- Updated state with completion timestamp and- Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-13 19:34:36 +08:00
starmen1265 d8f4df9149 docs(03-01): complete ASr processing plan 
- Created ASRInput/ASroOutput schemas
- Implemented ASRProcessor with subtitle-first strategy
- Added whisper.cpp integration with auto-cleanup
- Integrated speaker diarization (HF_TOKEN detection)
- All 22 tests passing

- Updated ROADmap progress: Phase 3: 1/1 complete
- Updated state with completion timestamp

- recorded execution metrics

- Updated session info
- Added final documentation commit
 2026-03-13 19:29:27 +08:00
starmen1265 acb6e15621 docs(state): record phase 3 context session 2026-03-13 18:50:40 +08:00
starmen1265 cfd61d6cf6 docs(phase-02): complete phase execution 2026-03-13 18:32:20 +08:00
starmen1265 45df259047 docs(02-02): complete bilibili adapter plan 
- Create 02-02-SUMMARY.md with execution results
- Update STATE.md with decisions and session info
- Update ROADMAP.md with plan progress

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-13 18:27:51 +08:00
starmen1265 d7f1ddde47 docs(02-03): complete zhihu adapter plan 
- ZhihuAdapter supports answer and zhuanlan content extraction
- Cookie-based authentication with login page detection
- Markdown output with YAML frontmatter
- 13 new tests, all 35 platform tests passing
- Test coverage: 86%

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-13 18:27:10 +08:00