24 Commits

Author SHA1 Message Date
starmen1265 cb540eb113 Merge pull request 'fix(kb_workflow): resolve module/package naming conflict' (#30) from fix/crawler-proxy-config into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/30
2026-03-18 10:42:16 +08:00
starmen1265 9c8ac34138 fix(kb_workflow): resolve module/package naming conflict
PR Test / lint (pull_request) Successful in 1s
Rename kb_workflow.py to cli.py to avoid conflict with kb_workflow/ package.
Add __main__.py to support `python -m kb_workflow` execution.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-18 10:35:33 +08:00
starmen1265 94a51abed8 Merge pull request 'fix/crawler-proxy-config' (#29) from fix/crawler-proxy-config into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/29
2026-03-18 00:05:47 +08:00
starmen1265 9d2433322a fix(crawler): set proxy_required=False by default
PR Test / lint (pull_request) Successful in 2s
旁路由 (192.168.1.200) provides automatic system-level proxy.
No explicit HTTP_PROXY/HTTPS_PROXY configuration needed.
2026-03-18 00:04:48 +08:00
starmen1265 e1d3218a44 Merge branch 'fix/ci-deploy-reset' 2026-03-18 00:03:43 +08:00
starmen1265 d88f1a3b8d Merge pull request 'docs(skill): update kb_workflow SKILL.md to reflect current implementation' (#28) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/28
2026-03-17 23:52:57 +08:00
starmen1265 5ccabec3e4 Merge pull request 'fix(ci): correct skill directory names in deploy.yml' (#27) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/27
2026-03-17 23:41:51 +08:00
starmen1265 289be86fc6 Merge pull request 'fix/ci-deploy-reset' (#26) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/26
2026-03-17 23:28:17 +08:00
starmen1265 79cf9635c6 Merge pull request 'fix/ci-deploy-reset' (#25) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/25
2026-03-17 15:35:59 +08:00
starmen1265 bc5e02249d Merge pull request 'feat(kb_workflow): add archive_file to process_command return value' (#24) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/24
2026-03-17 13:54:58 +08:00
starmen1265 36de6cf6dd Merge pull request 'fix(download): return author name instead of mid in _extract_author' (#23) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/23
2026-03-17 13:51:49 +08:00
starmen1265 23254afc49 Merge pull request 'fix(debug): resolve kb-pipeline import issue in skill directory' (#22) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/22
2026-03-17 11:18:24 +08:00
starmen1265 00b8e103c0 Merge pull request 'fix/ci-deploy-reset' (#21) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/21
2026-03-17 00:41:46 +08:00
starmen1265 7a1b2fc244 Merge pull request 'fix/ci-deploy-reset' (#20) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/20
2026-03-17 00:26:41 +08:00
starmen1265 61c4fd401f Merge pull request 'fix/ci-deploy-reset' (#19) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/19
2026-03-16 18:21:01 +08:00
starmen1265 71176c9a12 Merge pull request 'restore: 恢复误删的技能目录并修复导入方式' (#18) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/18
2026-03-16 17:28:19 +08:00
starmen1265 b5cd81d6e7 Merge pull request '删除就技能' (#17) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/17
2026-03-16 16:56:03 +08:00
starmen1265 46aab1d9f4 Merge pull request 'fix/ci-deploy-reset' (#16) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/16
2026-03-16 15:38:48 +08:00
starmen1265 ed1de1a5b1 Merge pull request 'fix(zhihu): remove noscript tags to prevent duplicate images' (#15) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/15
2026-03-16 15:09:57 +08:00
starmen1265 b89627b8ce Merge pull request 'fix(bilibili): correct metadata and filename in archive' (#14) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/14
2026-03-16 13:49:42 +08:00
starmen1265 33c2fd4bcd Merge pull request 'refactor: remove deprecated kb-xxx sub-skills' (#13) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/13
2026-03-16 12:09:09 +08:00
starmen1265 b3e40b3344 Merge pull request 'fix/ci-deploy-reset' (#12) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/12
2026-03-16 00:25:42 +08:00
starmen1265 9f12b35e6d Merge pull request 'fix/ci-deploy-reset' (#11) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/11
2026-03-15 23:01:13 +08:00
starmen1265 4fde411be3 Merge pull request 'fix/ci-deploy-reset' (#10) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/10
2026-03-15 18:18:24 +08:00
4 changed files with 36 additions and 20 deletions
+1 -1
View File
@@ -3,6 +3,6 @@
知识库工作流管道入口。
"""
from .kb_workflow import process_command, main
from .cli import process_command, main
__all__ = ["process_command", "main"]
+12
View File
@@ -0,0 +1,12 @@
#!/usr/bin/env python3
# -*- coding: utf-8 -*-
"""
KB Workflow 包入口点
支持通过 python -m kb_workflow 直接运行 CLI。
"""
from .cli import main
if __name__ == '__main__':
main()
@@ -9,11 +9,15 @@ KB Workflow - Knowledge Base Workflow Orchestrator
内部使用 kb_workflow.pipeline 包实现完整的内容处理流程。
使用方式:
python kb_workflow.py process "https://www.bilibili.com/video/BVxxx"
python kb_workflow.py process "https://..." -o /path/to/output
python kb_workflow.py login # QR code login
python kb_workflow.py login --import-cookie cookies.json
python kb_workflow.py login --status
python -m kb_workflow process "https://www.bilibili.com/video/BVxxx"
python -m kb_workflow process "https://..." -o /path/to/output
python -m kb_workflow login # QR code login
python -m kb_workflow login --import-cookie cookies.json
python -m kb_workflow login --status
或者通过包接口调用:
from kb_workflow import process_command
result = process_command("https://...")
"""
import argparse
@@ -41,13 +45,13 @@ def process_command(
Dictionary with success status, content_dir, and results
"""
try:
from kb_workflow.pipeline.config import get_settings
from kb_workflow.pipeline.pipeline import Pipeline
from kb_workflow.pipeline.processors import (
from .pipeline.config import get_settings
from .pipeline.pipeline import Pipeline
from .pipeline.processors import (
ASRProcessor, AnalyzeProcessor, ArchiveProcessor,
DownloadProcessor, ParseProcessor
)
from kb_workflow.pipeline.schemas import PipelineConfig
from .pipeline.schemas import PipelineConfig
async def run_pipeline():
# Determine output directory - default to intermediate_path
@@ -119,9 +123,9 @@ def login_command(
Dictionary with login result
"""
try:
from kb_workflow.auth import ZhihuLogin
from kb_workflow.auth.cookie_manager import CookieManager, parse_json_cookies
from kb_workflow.pipeline.config import get_settings
from .auth import ZhihuLogin
from .auth.cookie_manager import CookieManager, parse_json_cookies
from .pipeline.config import get_settings
settings = get_settings()
manager = CookieManager()
@@ -175,22 +179,22 @@ def main():
epilog='''
使用示例:
# 处理URL (通过完整管道)
python kb_workflow.py process "https://www.bilibili.com/video/BVxxx"
python -m kb_workflow process "https://www.bilibili.com/video/BVxxx"
# 指定输出目录
python kb_workflow.py process "https://..." -o /path/to/output
python -m kb_workflow process "https://..." -o /path/to/output
# 强制重新执行(忽略已完成状态)
python kb_workflow.py process "https://..." --no-skip
python -m kb_workflow process "https://..." --no-skip
# 知乎登录 (二维码扫码)
python kb_workflow.py login
python -m kb_workflow login
# 导入 Cookie
python kb_workflow.py login --import-cookie cookies.json
python -m kb_workflow login --import-cookie cookies.json
# 检查 Cookie 状态
python kb_workflow.py login --status
python -m kb_workflow login --status
'''
)
+1 -1
View File
@@ -54,7 +54,7 @@ class CrawlerConfig(BaseModel):
# Proxy settings
proxy: Optional[ProxyConfig] = Field(None, description="Proxy configuration")
proxy_required: bool = Field(default=True, description="Whether proxy is mandatory")
proxy_required: bool = Field(default=False, description="Whether proxy is mandatory (False for 旁路由 auto-proxy)")
# Rate limiting
min_delay: float = Field(default=1.0, description="Minimum delay between requests (seconds)")