starmen1265/kb-skills
Archived
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs(08-03): complete anti-crawl measures plan

Browse Source 
- Proxy configuration from HTTP_PROXY/HTTPS_PROXY
- Random delay (1-3s) between requests
- Exponential backoff retry (3 attempts)
- x-zse-96 signature handled by browser

All 44 crawler tests passing

Requirements: NET-01, NET-02, NET-03 completed

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
starmen1265
2026-03-17 22:20:38 +08:00
parent 9e1452d2a9
commit 123e307522
3 changed files with 151 additions and 59 deletions
Download Patch File Download Diff File Expand all files Collapse all files
.planning/REQUIREMENTS.md
+6 -6
View File
@@ -23,9 +23,9 @@
### 网络与反爬
- [ ] **NET-01**: 支持代理 IP 配置
- [ ] **NET-02**: 请求频率控制，避免触发反爬
- [ ] **NET-03**: 自动获取请求签名（x-zse-96），无需手动逆向
- [x] **NET-01**: 支持代理 IP 配置
- [x] **NET-02**: 请求频率控制，避免触发反爬
- [x] **NET-03**: 自动获取请求签名（x-zse-96），无需手动逆向
### Pipeline 整合
@@ -119,9 +119,9 @@
| CONT-02 | Phase 8 | Complete |
| CONT-03 | Phase 8 | Complete |
| CONT-04 | Phase 8 | Complete |
| NET-01 | Phase 8 | Pending |
| NET-02 | Phase 8 | Pending |
| NET-03 | Phase 8 | Pending |
| NET-01 | Phase 8 | Complete |
| NET-02 | Phase 8 | Complete |
| NET-03 | Phase 8 | Complete |
| PIPE-01 | Phase 9 | Pending |
| PIPE-02 | Phase 9 | Pending |
| PIPE-03 | Phase 9 | Pending |