--- gsd_state_version: 1.0 milestone: v1.3 milestone_name: Anti-Crawler Optimization status: planning stopped_at: Defining requirements last_updated: "2026-03-18T00:00:00.000Z" last_activity: 2026-03-18 — Milestone v1.3 started progress: total_phases: 0 completed_phases: 0 total_plans: 0 completed_plans: 0 percent: 0 --- # Project State ## Project Reference See: .planning/PROJECT.md (updated 2026-03-18) **Core value:** 可靠、可维护的处理管道 - 每个步骤独立、可验证、可恢复 **Current focus:** v1.3 Anti-Crawler Optimization — 反爬优化 ## Current Position Phase: Not started (defining requirements) Plan: — Status: Defining requirements Last activity: 2026-03-18 — Milestone v1.3 started Progress: [░░░░░░░░░░] 0% (v1.3 milestone - requirements phase) ## Performance Metrics **Velocity:** - Total plans completed: 0 (v1.3) - Average duration: — - Total execution time: — | Plan | Duration | Tasks | Files | Date | |------|----------|-------|-------|------| | (no plans yet) | ## Accumulated Context ### Decisions Key decisions from v1.0 (preserved): - 管道模型 — BaseProcessor + Pipeline 架构 - 步骤级状态 — WorkflowStateManager - Schema 验证 — Pydantic v2 - 顺序执行 — 简单性和可调试性 - CLI subparsers — 可扩展命令结构 v1.1 decisions: - 中间目录统一到 `~/work/intermediate/analysis/` - 归档只保留 md 文件,不归档 json 文件 - 最终目录按平台分组,不再按时间创建子目录 v1.2 decisions: - 知乎登录策略:二维码扫码 + 手动 Cookie 降级 - 参考 MediaCrawler 实现,自实现而非直接依赖 - 使用 playwright 作为浏览器自动化框架 - 整合进现有 Pipeline 架构 - Cookie 文件权限设置为 600 保证安全性 - 保存 Cookie 后清除 get_settings 缓存确保配置刷新 - 使用 tenacity Retrying 对象而非 @retry 装饰器支持可配置超时 - 多个 canvas 选择器降级提高 QR 码检测鲁棒性 - login CLI 命令支持三种模式:扫码登录、导入 Cookie、状态检查 - Use Playwright request API for direct comment API calls instead of route interception - Only fetch first-level comments (no nested replies) - Use hot sorting (order=hot) for popular comments - ZhihuAdapter uses ZhihuCrawler with comment crawling enabled by default - Cookie expiration triggers automatic QR code login flow - Comments appended to content in Markdown format with '## 热门评论' section ### Blockers/Concerns None. ## Session Continuity Last session: — Stopped at: Defining requirements Resume file: None **Next step:** Define v1.3 requirements and create roadmap