This repository has been archived on 2026-08-07. You can view files and clone it. You cannot open issues or pull requests or push a commit.

starmen1265 123e307522 docs(08-03): complete anti-crawl measures plan ...

- Proxy configuration from HTTP_PROXY/HTTPS_PROXY
- Random delay (1-3s) between requests
- Exponential backoff retry (3 attempts)
- x-zse-96 signature handled by browser

All 44 crawler tests passing

Requirements: NET-01, NET-02, NET-03 completed

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-03-17 22:20:38 +08:00

..

__init__.py

feat(08-01): create crawler data models and test scaffolding

2026-03-17 21:06:33 +08:00

conftest.py

feat(08-01): create crawler data models and test scaffolding

2026-03-17 21:06:33 +08:00

test_answer_crawler.py

test(08-01): add failing tests for ZhihuCrawler

2026-03-17 21:08:13 +08:00

test_api_intercept.py

feat(08-03): integrate proxy, delay, and retry into ZhihuCrawler

2026-03-17 22:14:47 +08:00

test_article_crawler.py

test(08-01): add failing tests for ZhihuCrawler

2026-03-17 21:08:13 +08:00

test_comment_crawler.py

docs(08-03): complete anti-crawl measures plan

2026-03-17 22:20:38 +08:00

test_metadata_extraction.py

test(08-01): add failing tests for ZhihuCrawler

2026-03-17 21:08:13 +08:00

test_proxy_config.py

feat(08-03): create CrawlerConfig for proxy and rate limiting

2026-03-17 21:57:09 +08:00

test_rate_limiter.py

feat(08-03): integrate proxy, delay, and retry into ZhihuCrawler

2026-03-17 22:14:47 +08:00