This repository has been archived on 2026-08-07. You can view files and clone it. You cannot open issues or pull requests or push a commit.

starmen1265 b66bcc08b1 feat(10-02): integrate ProxyPool into ZhihuCrawler ...

- Add proxy_pool parameter to ZhihuCrawler constructor
- Add _current_proxy tracking for health check feedback
- Implement _parse_proxy_url static method for URL parsing
- Implement _on_request_success/failure for proxy health feedback
- Prioritize proxy_pool over config.proxy for multi-proxy support
- Maintain backward compatibility with single proxy config

Tests:
- test_crawler_accepts_proxy_pool
- test_crawler_without_proxy_pool (backward compatibility)
- test_parse_proxy_url (HTTP, auth, SOCKS5)
- test_proxy_pool_takes_priority_over_config

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-03-18 16:48:48 +08:00

..

__init__.py

feat(08-02): implement crawl_comments method with hot sorting

2026-03-17 21:56:47 +08:00

config.py

fix(crawler): set proxy_required=False by default

2026-03-18 00:04:48 +08:00

models.py

feat(08-02): add CommentData models for comment crawling

2026-03-17 21:53:17 +08:00

proxy_pool.py

feat(10-01): implement proxy pool core functionality

2026-03-18 16:39:39 +08:00

zhihu_crawler.py

feat(10-02): integrate ProxyPool into ZhihuCrawler

2026-03-18 16:48:48 +08:00