Commit Graph

36 Commits

Author SHA1 Message Date
starmen1265 b312612e6c docs(12-01): complete SRT Processing Module plan
- Create 12-01-SUMMARY.md with implementation details
- Update STATE.md with current position (Phase 12, 50% complete)
- Update ROADMAP.md with plan progress
- Mark requirements SRT-01~04, OUT-01~02, OUT-04 as complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-19 23:41:13 +08:00
starmen1265 978613461b docs: create milestone v1.5 requirements and roadmap 2026-03-19 23:18:50 +08:00
starmen1265 fa46062698 chore: archive v1.4 milestone - clean up moved files
PR Test / lint (pull_request) Successful in 2s
- Delete .planning/REQUIREMENTS.md (archived to milestones/)
- Delete .planning/phases/11-stealth-fingerprinting/* (moved to milestones/v1.4-phases/)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-19 00:05:27 +08:00
starmen1265 b81eec4284 docs(11-02): complete stealth integration plan
- Created 11-02-SUMMARY.md with execution results
- Updated STATE.md: v1.4 milestone complete, 100% progress
- Updated ROADMAP.md: Phase 11 complete, all plans done
- Updated REQUIREMENTS.md: VERIFY-01, VERIFY-02 complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-18 23:56:09 +08:00
starmen1265 b9f74e5a7e docs(11-01): complete stealth fingerprint masking plan
- Created 11-01-SUMMARY.md with execution results
- Updated STATE.md: Plan 1/2 complete, 50% progress
- Updated ROADMAP.md: 11-01 marked complete
- Updated REQUIREMENTS.md: STEALTH-01 to STEALTH-04 complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-18 23:50:24 +08:00
starmen1265 eb90773422 docs: define v1.4 Zhihu Anti-Crawler requirements 2026-03-18 23:16:35 +08:00
starmen1265 a9ead75da7 chore: complete v1.3 Proxy Pool milestone 2026-03-18 22:45:17 +08:00
starmen1265 bcfef48676 docs(10-02): complete health check and crawler integration plan 2026-03-18 16:51:16 +08:00
starmen1265 96dfdce59c docs(10-01): complete proxy pool core plan
- SUMMARY.md: proxy pool infrastructure with round-robin rotation
- STATE.md: updated position to Plan 1 of 2
- ROADMAP.md: marked 10-01 complete
- REQUIREMENTS.md: marked PROXY-01, PROXY-02 complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-18 16:43:34 +08:00
starmen1265 887ced6075 docs: define v1.3 anti-crawler requirements 2026-03-18 13:07:46 +08:00
starmen1265 248a1f2b8c docs(09-01): complete ZhihuAdapter integration plan
- Integrated ZhihuCrawler into ZhihuAdapter
- Added comment crawling and formatting
- Implemented cookie auto-login flow
- Added idempotent execution via IdempotencyChecker

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 23:17:39 +08:00
starmen1265 123e307522 docs(08-03): complete anti-crawl measures plan
- Proxy configuration from HTTP_PROXY/HTTPS_PROXY
- Random delay (1-3s) between requests
- Exponential backoff retry (3 attempts)
- x-zse-96 signature handled by browser

All 44 crawler tests passing

Requirements: NET-01, NET-02, NET-03 completed

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 22:20:38 +08:00
starmen1265 6a4f13b2f6 docs(08-02): complete comment crawler plan
- Add 08-02-SUMMARY.md with execution details
- Update STATE.md with decisions and metrics
- Mark CONT-03 requirement complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 21:59:49 +08:00
starmen1265 f0ee4ca5e2 docs(08-01): complete zhihu content crawler plan
- ZhihuCrawler class with API interception
- AnswerData, ArticleData models
- 15 tests passing

Requirements: CONT-01, CONT-02, CONT-04 completed

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 21:51:56 +08:00
starmen1265 e8eaca519f docs(07-03): complete Login CLI Subcommand plan
- Cookie validation via /api/v4/me endpoint
- login CLI subcommand with 3 modes: scan, import, status
- AUTH-04 requirement complete: Cookie expiry detection
- Phase 7 Login Auth complete, ready for Phase 8 Crawler

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-17 18:24:32 +08:00
starmen1265 4228b1e3a1 docs(07-01): complete QR Code Login Core plan 2026-03-17 17:57:28 +08:00
starmen1265 771ca554b3 docs(07-02): complete cookie import & persistence plan 2026-03-17 17:53:38 +08:00
starmen1265 367b2816c4 docs: create milestone v1.2 roadmap (3 phases) 2026-03-17 16:31:17 +08:00
starmen1265 dcba34b643 docs: define milestone v1.2 requirements 2026-03-17 16:27:05 +08:00
starmen1265 2bec25e15c docs(06-03): complete gap closure plan 2026-03-17 00:37:30 +08:00
starmen1265 65fdf4646a docs(06-01): complete metadata consolidation plan 2026-03-17 00:08:09 +08:00
starmen1265 ea672f4526 docs(05-03): complete archive testing plan
- Add SUMMARY.md with 8 tests (5 unit + 3 integration)
- Update STATE.md: Phase 5 complete, advance to Phase 6
- Mark requirements OUT-01, OUT-02, OUT-03, OUT-04 complete
- Document test patterns and decisions

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 23:31:47 +08:00
starmen1265 bd5ffab6e7 docs(05-02): complete ArchiveProcessor implementation plan 2026-03-16 23:21:06 +08:00
starmen1265 129a6311f4 docs(05-01): complete unified intermediate directory plan
- Added intermediate_path config field with KB_INTERMEDIATE_PATH env var support
- Updated Pipeline to use configurable intermediate directory
- Updated CLI to default to intermediate_path instead of cwd
- Completed requirements: INT-01, INT-02, INT-03

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-16 23:16:09 +08:00
starmen1265 0bc5bb7584 docs: create milestone v1.1 roadmap (2 phases) 2026-03-16 21:06:43 +08:00
starmen1265 90b5ec2a27 docs: define milestone v1.1 requirements 2026-03-16 20:58:59 +08:00
starmen1265 46f7feb146 chore: complete v1.0 milestone
- Archive ROADMAP and REQUIREMENTS to milestones/
- Delete original ROADMAP.md and REQUIREMENTS.md
- Update PROJECT.md with v1.0 validated requirements
- Update STATE.md for milestone complete status
- Update MILESTONES.md with key accomplishments
- Add VERIFICATION.md for phase 04

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-15 00:59:18 +08:00
starmen1265 57e6d9b6b2 docs(04-01): complete BaseProcessor and ParseProcessor plan
- BaseProcessor abstract class with unified interface
- ParseProcessor wrapping LinkParser for URL parsing
- ParseInput/ParseOutput schemas for parse step
- All tests passing (18 tests)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-13 23:16:17 +08:00
starmen1265 ae7dea9581 docs(02-01): complete link parser & idempotency plan
- Created LinkParser for unified URL parsing (B站/知乎)
- Created IdempotencyChecker for file existence checking
- All 23 new tests passing, 95% coverage
- Requirements PLAT-01, PLAT-02, PLAT-03 completed

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-13 18:16:04 +08:00
starmen1265 b7db451d9d docs(01-03): complete error handler & config manager plan
- Structured error types with rich context (KBError, NetworkError, etc.)
- Configuration management via pydantic-settings from ~/.kb_env
- Automatic retry mechanism with tenacity (3 attempts, exponential backoff)
- All 100 tests passing
- Requirements REL-02, MNT-02, MNT-03 completed

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-13 17:22:58 +08:00
starmen1265 46f1724e06 docs(01-01): complete WorkflowStateManager plan
Summary:
- WorkflowStateManager with atomic write and backup rotation
- 90% test coverage (20 tests)
- 5 min execution time

State updates:
- Plan counter advanced to 3
- Progress: 67% (2/3 plans complete)
- Requirements marked complete: PIPE-02, REL-01

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-13 17:19:37 +08:00
starmen1265 3cec1cafaf docs(01-02): complete core pipeline schemas plan
- Create 01-02-SUMMARY.md with execution results
- Update STATE.md: Plan 2 of 3 completed, 8% progress
- Mark requirements complete: PIPE-01, PIPE-03, VAL-01, REL-03
- Update ROADMAP.md with plan progress

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-13 17:11:30 +08:00
starmen1265 2ed555ccc2 docs: create roadmap (4 phases) 2026-03-13 16:06:47 +08:00
starmen1265 ab952f4c69 docs: define v1 requirements 2026-03-13 15:55:57 +08:00
starmen1265 1d7957aab4 chore: remove dev-workflow skill and related GSD files
The dev-workflow multi-agent orchestration skill is no longer needed.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-13 14:42:33 +08:00
starmen1265 e23b88c3fa docs: initialize dev-workflow project with GSD
- PROJECT.md: 项目愿景和核心价值
- REQUIREMENTS.md: 21个v1需求 + 4个v2延期需求
- ROADMAP.md: 11阶段开发路线图
- STATE.md: 项目状态跟踪
- config.json: GSD工作流配置
2026-03-09 18:54:17 +08:00