docs: create v1.4 Zhihu Anti-Crawler roadmap (1 phase, 2 plans)

2026-03-18 23:19:25 +08:00
parent eb90773422
commit 9e30e042a8
2 changed files with 65 additions and 53 deletions
@@ -6,6 +6,7 @@
 - ✅ **v1.1 Architecture Refactor** - Phases 5-6 (shipped 2026-03-16)
 - ✅ **v1.2 Zhihu Crawler** - Phases 7-9 (shipped 2026-03-17)
 - ✅ **v1.3 Proxy Pool** - Phase 10 (shipped 2026-03-18)
+- 🚧 **v1.4 Zhihu Anti-Crawler** - Phase 11 (in progress)

 ## Phases

@@ -95,19 +96,49 @@ Plans:
 - 惰性冷却检查而非后台定时器
 - ProxyPool 参数优先于 config.proxy 配置

-**Known Gaps (deferred):**
- BEHAV-01~04: 请求行为伪装
- CAPT-01~03: 验证码检测
- ERR-01~04: 错误恢复机制
- PLAT-01~02: 平台适配
-
 </details>

 ---

-## Next Milestone
+## 🚧 v1.4 Zhihu Anti-Crawler (In Progress)

-Run `/gsd:new-milestone` to plan the next version.
+**Milestone Goal:** 绕过知乎反爬检测，让 Playwright 爬虫能正常工作
+
+### Phase 11: Stealth Fingerprinting (指纹伪装)
+**Goal**: 隐藏 Playwright 自动化特征，让爬虫通过知乎的浏览器指纹检测
+**Depends on**: Phase 10
+**Requirements**: STEALTH-01, STEALTH-02, STEALTH-03, STEALTH-04, VERIFY-01, VERIFY-02
+**Success Criteria** (what must be TRUE):
+  1. ZhihuCrawler 访问问答页面时不再被 40362 错误拦截
+  2. 爬虫的 navigator.webdriver 属性对知乎不可见
+  3. Playwright 特有的 JS 属性（__playwright, pwInspect 等）被移除
+  4. 现有功能（登录、Cookie 持久化、内容爬取）保持正常工作
+**Plans**: TBD
+
+Plans:
+- [ ] 11-01: 指纹伪装脚本实现 — 隐藏 webdriver、移除 Playwright 特有属性、模拟 Chrome 特性
+- [ ] 11-02: ZhihuCrawler 集成与验证 — 注入伪装脚本，验证爬取功能正常
+
+---
+
+## Progress
+
+**Execution Order:**
+Phases execute in numeric order: 1 → 2 → ... → 10 → 11
+
+| Phase | Milestone | Plans Complete | Status | Completed |
+|-------|-----------|----------------|--------|-----------|
+| 1. Foundation | v1.0 | 3/3 | Complete | 2026-03-15 |
+| 2. Adapters | v1.0 | 2/2 | Complete | 2026-03-15 |
+| 3. Processors | v1.0 | 3/3 | Complete | 2026-03-15 |
+| 4. Pipeline | v1.0 | 2/2 | Complete | 2026-03-15 |
+| 5. 归档与目录优化 | v1.1 | 3/3 | Complete | 2026-03-16 |
+| 6. 代码整合 | v1.1 | 3/3 | Complete | 2026-03-16 |
+| 7. 登录认证体系 | v1.2 | 3/3 | Complete | 2026-03-17 |
+| 8. 内容爬取实现 | v1.2 | 3/3 | Complete | 2026-03-17 |
+| 9. Pipeline 整合 | v1.2 | 1/1 | Complete | 2026-03-17 |
+| 10. Proxy Pool | v1.3 | 2/2 | Complete | 2026-03-18 |
+| 11. Stealth Fingerprinting | v1.4 | 0/2 | Not started | - |

 ---