115 lines
2.9 KiB
Markdown
115 lines
2.9 KiB
Markdown
# Roadmap: kb-skills
|
|
|
|
## Milestones
|
|
|
|
- ✅ **v1.0 Pipeline Architecture** - Phases 1-4 (shipped 2026-03-15)
|
|
- ✅ **v1.1 Architecture Refactor** - Phases 5-6 (shipped 2026-03-16)
|
|
- ✅ **v1.2 Zhihu Crawler** - Phases 7-9 (shipped 2026-03-17)
|
|
- ✅ **v1.3 Proxy Pool** - Phase 10 (shipped 2026-03-18)
|
|
|
|
## Phases
|
|
|
|
<details>
|
|
<summary>✅ v1.0 Pipeline Architecture (Phases 1-4) - SHIPPED 2026-03-15</summary>
|
|
|
|
### Phase 1: Foundation
|
|
**Goal**: 项目基础设施和状态管理
|
|
**Plans**: 3 plans
|
|
|
|
Plans:
|
|
- [x] 01-01: WorkflowStateManager 状态管理
|
|
- [x] 01-02: LinkParser URL 解析
|
|
- [x] 01-03: IdempotencyChecker 幂等检查
|
|
|
|
### Phase 2: Adapters
|
|
**Goal**: 平台元数据适配器
|
|
**Plans**: 2 plans
|
|
|
|
Plans:
|
|
- [x] 02-01: BilibiliAdapter B站适配器
|
|
- [x] 02-02: ZhihuAdapter 知乎适配器
|
|
|
|
### Phase 3: Processors
|
|
**Goal**: 管道处理器架构
|
|
**Plans**: 3 plans
|
|
|
|
Plans:
|
|
- [x] 03-01: BaseProcessor 基类
|
|
- [x] 03-02: 具体处理器实现
|
|
- [x] 03-03: Schema 验证
|
|
|
|
### Phase 4: Pipeline
|
|
**Goal**: 处理器编排和 CLI
|
|
**Plans**: 2 plans
|
|
|
|
Plans:
|
|
- [x] 04-01: Pipeline 编排引擎
|
|
- [x] 04-02: CLI process 命令
|
|
|
|
</details>
|
|
|
|
<details>
|
|
<summary>✅ v1.1 Architecture Refactor (Phases 5-6) - SHIPPED 2026-03-16</summary>
|
|
|
|
### Phase 5: 归档与目录优化
|
|
**Goal**: 统一中间目录结构，添加自动归档步骤，优化最终目录布局
|
|
**Plans**: 3 plans (all complete)
|
|
|
|
### Phase 6: 代码整合
|
|
**Goal**: 将独立的元数据技能和 Pipeline 模块整合进 kb-workflow
|
|
**Plans**: 3 plans (all complete)
|
|
|
|
</details>
|
|
|
|
<details>
|
|
<summary>✅ v1.2 Zhihu Crawler (Phases 7-9) - SHIPPED 2026-03-17</summary>
|
|
|
|
### Phase 7: 登录认证体系
|
|
**Goal**: 建立知乎登录认证机制，支持二维码扫码和手动 Cookie 两种方式
|
|
**Plans**: 3 plans (all complete)
|
|
|
|
### Phase 8: 内容爬取实现
|
|
**Goal**: 实现知乎问答、专栏/文章、评论的完整爬取功能
|
|
**Plans**: 3 plans (all complete)
|
|
|
|
### Phase 9: Pipeline 整合
|
|
**Goal**: 将新爬虫实现整合进现有 Pipeline 架构
|
|
**Plans**: 1 plan (complete)
|
|
|
|
</details>
|
|
|
|
<details>
|
|
<summary>✅ v1.3 Proxy Pool (Phase 10) - SHIPPED 2026-03-18</summary>
|
|
|
|
### Phase 10: Proxy Pool (代理池管理)
|
|
**Goal**: 建立代理池基础设施，支持多代理配置、自动轮换和健康检查
|
|
**Requirements**: PROXY-01, PROXY-02, PROXY-03, PROXY-04
|
|
**Plans**: 2 plans (all complete)
|
|
|
|
Plans:
|
|
- [x] 10-01: ProxyPool 核心类实现 — 从 YAML/环境变量加载代理，Round-Robin 轮换
|
|
- [x] 10-02: 健康检查与 ZhihuCrawler 集成 — 被动检测、冷却恢复、代理切换
|
|
|
|
**Key Decisions:**
|
|
- 使用索引指针而非 itertools.cycle 实现轮换
|
|
- 惰性冷却检查而非后台定时器
|
|
- ProxyPool 参数优先于 config.proxy 配置
|
|
|
|
**Known Gaps (deferred):**
|
|
- BEHAV-01~04: 请求行为伪装
|
|
- CAPT-01~03: 验证码检测
|
|
- ERR-01~04: 错误恢复机制
|
|
- PLAT-01~02: 平台适配
|
|
|
|
</details>
|
|
|
|
---
|
|
|
|
## Next Milestone
|
|
|
|
Run `/gsd:new-milestone` to plan the next version.
|
|
|
|
---
|
|
|
|
*Last updated: 2026-03-18*
|