97 lines
3.2 KiB
Markdown
97 lines
3.2 KiB
Markdown
---
|
|
gsd_state_version: 1.0
|
|
milestone: v1.2
|
|
milestone_name: Zhihu Crawler
|
|
status: completed
|
|
stopped_at: Completed 09-01 ZhihuAdapter integration
|
|
last_updated: "2026-03-17T15:25:04.074Z"
|
|
last_activity: 2026-03-17 — Phase 09-00 Test scaffolding complete
|
|
progress:
|
|
total_phases: 9
|
|
completed_phases: 8
|
|
total_plans: 27
|
|
completed_plans: 26
|
|
percent: 100
|
|
---
|
|
|
|
# Project State
|
|
|
|
## Project Reference
|
|
|
|
See: .planning/PROJECT.md (updated 2026-03-17)
|
|
|
|
**Core value:** 可靠、可维护的处理管道 - 每个步骤独立、可验证、可恢复
|
|
**Current focus:** v1.2 Zhihu Crawler — Phase 9 执行中
|
|
|
|
## Current Position
|
|
|
|
Phase: 9 of 9 (Pipeline Integration - 管道整合)
|
|
Plan: 01 of 04
|
|
Status: Phase 09-00 Wave 0 complete
|
|
Last activity: 2026-03-17 — Phase 09-00 Test scaffolding complete
|
|
|
|
Progress: [██████████] 100% (v1.2 milestone - Phase 9 in progress)
|
|
|
|
## Performance Metrics
|
|
|
|
**Velocity:**
|
|
- Total plans completed: 3 (v1.2)
|
|
- Average duration: 11 min
|
|
- Total execution time: 32 min
|
|
|
|
| Plan | Duration | Tasks | Files | Date |
|
|
|------|----------|-------|-------|------|
|
|
| 07-01 | 15min | 2 | 5 | 2026-03-17 |
|
|
| 07-02 | 5min | 2 | 4 | 2026-03-17 |
|
|
| 07-03 | 12min | 3 | 4 | 2026-03-17 |
|
|
| Phase 08 P01 | 3min | 2 | 8 | 2026-03-17 |
|
|
| Phase 08 P02 | 5min | 2 | 3 | 2026-03-17 |
|
|
| Phase 08 P03 | 15min | 2 | 5 | 2026-03-17 |
|
|
| 09-00 | 2min | 1 | 1 | 2026-03-17 |
|
|
| Phase 09-pipeline-integration P01 | 11min | 3 tasks | 2 files |
|
|
|
|
## Accumulated Context
|
|
|
|
### Decisions
|
|
|
|
Key decisions from v1.0 (preserved):
|
|
- 管道模型 — BaseProcessor + Pipeline 架构
|
|
- 步骤级状态 — WorkflowStateManager
|
|
- Schema 验证 — Pydantic v2
|
|
- 顺序执行 — 简单性和可调试性
|
|
- CLI subparsers — 可扩展命令结构
|
|
|
|
v1.1 decisions:
|
|
- 中间目录统一到 `~/work/intermediate/analysis/`
|
|
- 归档只保留 md 文件，不归档 json 文件
|
|
- 最终目录按平台分组，不再按时间创建子目录
|
|
|
|
v1.2 decisions:
|
|
- 知乎登录策略：二维码扫码 + 手动 Cookie 降级
|
|
- 参考 MediaCrawler 实现，自实现而非直接依赖
|
|
- 使用 playwright 作为浏览器自动化框架
|
|
- 整合进现有 Pipeline 架构
|
|
- Cookie 文件权限设置为 600 保证安全性
|
|
- 保存 Cookie 后清除 get_settings 缓存确保配置刷新
|
|
- 使用 tenacity Retrying 对象而非 @retry 装饰器支持可配置超时
|
|
- 多个 canvas 选择器降级提高 QR 码检测鲁棒性
|
|
- login CLI 命令支持三种模式：扫码登录、导入 Cookie、状态检查
|
|
- [Phase 08-02]: Use Playwright request API for direct comment API calls instead of route interception
|
|
- [Phase ?]: - [Phase 08-02]: Only fetch first-level comments (no nested replies)
|
|
- [Phase ?]: - [Phase 08-02]: Use hot sorting (order=hot) for popular comments
|
|
- [Phase 09-01]: ZhihuAdapter uses ZhihuCrawler with comment crawling enabled by default
|
|
- [Phase 09-01]: Cookie expiration triggers automatic QR code login flow
|
|
- [Phase 09-01]: Comments appended to content in Markdown format with '## 热门评论' section
|
|
|
|
### Blockers/Concerns
|
|
|
|
None.
|
|
|
|
## Session Continuity
|
|
|
|
Last session: 2026-03-17T15:16:21.489Z
|
|
Stopped at: Completed 09-01 ZhihuAdapter integration
|
|
Resume file: None
|
|
|
|
**Next step:** Continue with Phase 09-01 ZhihuAdapter integration
|