fix/crawler-proxy-config #34

2026-03-20T00:11:51+08:00

starmen1265 commented

2026-03-20 00:11:51 +08:00

No description provided.

starmen1265 added 19 commits 2026-03-20 00:11:52 +08:00

docs: start milestone v1.5 B站字幕简化处理 d69b85cb1e

docs: create milestone v1.5 requirements and roadmap 978613461b

docs(12-srt-simplifier): create phase 12 plans 56039c5956

docs(12-02): fix autonomous flag for checkpoint task 40337940d8

test(12-01): add failing tests for SRT parser module 7023a57644

- Test standard SRT format parsing
- Test special character handling
- Test error handling for invalid/empty content
- Test file parsing functionality

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat(12-01): implement SRT parser module c259e0ac2f

- Add Segment dataclass for subtitle segments
- Add parse_srt() function to parse SRT content string
- Add parse_srt_file() function to parse from file path
- Support standard SRT format with timestamps
- Handle special characters and multi-line subtitles

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

test(12-01): add failing tests for SemanticSegmenter 81a7dc558b

- Test merging short segments into paragraphs
- Test segmentation on topic change (time gap)
- Test max paragraph length constraint
- Test empty segments handling

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat(12-01): implement SemanticSegmenter for subtitle segmentation a350693863

- Merge short segments into paragraphs
- Split on time gaps (>3 seconds by default)
- Enforce max paragraph length (500 chars by default)
- Simple rule-based approach (no LLM needed)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

test(12-01): add failing tests for ASRCorrector 757793bfa9

- Test obvious homophone error correction
- Test contextual error correction
- Test no overcorrection on correct text
- Test AI unavailable fallback
- Test batch processing for long text
- Test empty text handling

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat(12-01): implement ASRCorrector for speech recognition error correction 5e00632f68

- Use LLM to correct obvious ASR errors (homophones, missing words)
- Batch processing for long text (5000 chars per batch)
- Fallback to original text when AI unavailable
- Simple sentence-based text splitting

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat(12-01): implement SRTProcessor and Markdown generation 87b1919483

- Add SRTInput/SRTOutput schemas to pipeline
- Create SRTProcessor following BaseProcessor pattern
- Generate Markdown with YAML frontmatter
- Support metadata extraction and formatting
- Handle missing metadata gracefully

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

chore(12-01): update srt module exports 812f016b1b

- Add SemanticSegmenter and ASRCorrector to __all__
- Maintain lazy loading for optional dependencies

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

docs(12-01): complete SRT Processing Module plan b312612e6c

- Create 12-01-SUMMARY.md with implementation details
- Update STATE.md with current position (Phase 12, 50% complete)
- Update ROADMAP.md with plan progress
- Mark requirements SRT-01~04, OUT-01~02, OUT-04 as complete

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat(12-02): modify Pipeline for platform-specific processing flow 8d41a1b324

- Add Bilibili video detection: platform=bilibili and content_type=video
- Skip analyze step for Bilibili videos, use srt step instead
- Skip srt step for non-Bilibili-video content
- Add SRTInput import and step input creation logic
- Update _populate_skipped_step_results for srt step
- Add output_file, paragraphs, tags, corrected to result fields

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat(12-02): update CLI processor registration b3b6498a71

- Import SRTProcessor from processors module
- Add SRTProcessor to processors list
- Update PipelineConfig.steps to include 'srt' step
- Pipeline will select SRTProcessor or AnalyzeProcessor based on platform

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

test(12-02): add Bilibili video pipeline end-to-end tests 98709476ab

- Test Bilibili video uses SRTProcessor (not AnalyzeProcessor)
- Test Bilibili article uses AnalyzeProcessor (not SRTProcessor)
- Test Zhihu answer uses AnalyzeProcessor
- Test Markdown output format verification

All 4 tests pass.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

fix(12-02): add deprecation warning to DeepAnalyzer a175a3242c

- Add logging warning in DeepAnalyzer.__init__
- Warn that Bilibili video should use SRTProcessor instead
- Keep functionality intact for Zhihu and other platforms

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

docs(12-02): complete Pipeline Integration plan a04d5c1ddb

Phase 12 complete:
- B站视频使用 SRTProcessor 替代 AnalyzeProcessor
- Pipeline 平台路由逻辑实现
- 24 个测试全部通过
- DeepAnalyzer 添加弃用警告

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

docs(phase-12): complete phase execution - srt-simplifier

PR Test / lint (pull_request) Successful in 2s

Details

04f071b3bd

starmen1265 merged commit d17b55f6c5 into main

2026-03-20 00:12:04 +08:00

starmen1265 referenced this issue from a commit

2026-03-20 00:12:05 +08:00

Merge pull request 'fix/crawler-proxy-config' (#34) from fix/crawler-proxy-config into main

This repo is archived. You cannot comment on pull requests.

1 Participants

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: starmen1265/kb-skills#34