24 Commits

Author SHA1 Message Date
starmen1265 cb540eb113 Merge pull request 'fix(kb_workflow): resolve module/package naming conflict' (#30) from fix/crawler-proxy-config into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/30
2026-03-18 10:42:16 +08:00
starmen1265 9c8ac34138 fix(kb_workflow): resolve module/package naming conflict
PR Test / lint (pull_request) Successful in 1s
Rename kb_workflow.py to cli.py to avoid conflict with kb_workflow/ package.
Add __main__.py to support `python -m kb_workflow` execution.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-18 10:35:33 +08:00
starmen1265 94a51abed8 Merge pull request 'fix/crawler-proxy-config' (#29) from fix/crawler-proxy-config into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/29
2026-03-18 00:05:47 +08:00
starmen1265 9d2433322a fix(crawler): set proxy_required=False by default
PR Test / lint (pull_request) Successful in 2s
旁路由 (192.168.1.200) provides automatic system-level proxy.
No explicit HTTP_PROXY/HTTPS_PROXY configuration needed.
2026-03-18 00:04:48 +08:00
starmen1265 e1d3218a44 Merge branch 'fix/ci-deploy-reset' 2026-03-18 00:03:43 +08:00
starmen1265 d88f1a3b8d Merge pull request 'docs(skill): update kb_workflow SKILL.md to reflect current implementation' (#28) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/28
2026-03-17 23:52:57 +08:00
starmen1265 5ccabec3e4 Merge pull request 'fix(ci): correct skill directory names in deploy.yml' (#27) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/27
2026-03-17 23:41:51 +08:00
starmen1265 289be86fc6 Merge pull request 'fix/ci-deploy-reset' (#26) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/26
2026-03-17 23:28:17 +08:00
starmen1265 79cf9635c6 Merge pull request 'fix/ci-deploy-reset' (#25) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/25
2026-03-17 15:35:59 +08:00
starmen1265 bc5e02249d Merge pull request 'feat(kb_workflow): add archive_file to process_command return value' (#24) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/24
2026-03-17 13:54:58 +08:00
starmen1265 36de6cf6dd Merge pull request 'fix(download): return author name instead of mid in _extract_author' (#23) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/23
2026-03-17 13:51:49 +08:00
starmen1265 23254afc49 Merge pull request 'fix(debug): resolve kb-pipeline import issue in skill directory' (#22) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/22
2026-03-17 11:18:24 +08:00
starmen1265 00b8e103c0 Merge pull request 'fix/ci-deploy-reset' (#21) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/21
2026-03-17 00:41:46 +08:00
starmen1265 7a1b2fc244 Merge pull request 'fix/ci-deploy-reset' (#20) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/20
2026-03-17 00:26:41 +08:00
starmen1265 61c4fd401f Merge pull request 'fix/ci-deploy-reset' (#19) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/19
2026-03-16 18:21:01 +08:00
starmen1265 71176c9a12 Merge pull request 'restore: 恢复误删的技能目录并修复导入方式' (#18) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/18
2026-03-16 17:28:19 +08:00
starmen1265 b5cd81d6e7 Merge pull request '删除就技能' (#17) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/17
2026-03-16 16:56:03 +08:00
starmen1265 46aab1d9f4 Merge pull request 'fix/ci-deploy-reset' (#16) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 1s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/16
2026-03-16 15:38:48 +08:00
starmen1265 ed1de1a5b1 Merge pull request 'fix(zhihu): remove noscript tags to prevent duplicate images' (#15) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/15
2026-03-16 15:09:57 +08:00
starmen1265 b89627b8ce Merge pull request 'fix(bilibili): correct metadata and filename in archive' (#14) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/14
2026-03-16 13:49:42 +08:00
starmen1265 33c2fd4bcd Merge pull request 'refactor: remove deprecated kb-xxx sub-skills' (#13) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/13
2026-03-16 12:09:09 +08:00
starmen1265 b3e40b3344 Merge pull request 'fix/ci-deploy-reset' (#12) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/12
2026-03-16 00:25:42 +08:00
starmen1265 9f12b35e6d Merge pull request 'fix/ci-deploy-reset' (#11) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/11
2026-03-15 23:01:13 +08:00
starmen1265 4fde411be3 Merge pull request 'fix/ci-deploy-reset' (#10) from fix/ci-deploy-reset into main
Deploy kb-skills / deploy (push) Successful in 2s
Reviewed-on: http://192.168.1.22:8418/starmen1265/kb-skills/pulls/10
2026-03-15 18:18:24 +08:00
4 changed files with 36 additions and 20 deletions
+1 -1
View File
@@ -3,6 +3,6 @@
知识库工作流管道入口。 知识库工作流管道入口。
""" """
from .kb_workflow import process_command, main from .cli import process_command, main
__all__ = ["process_command", "main"] __all__ = ["process_command", "main"]
+12
View File
@@ -0,0 +1,12 @@
#!/usr/bin/env python3
# -*- coding: utf-8 -*-
"""
KB Workflow 包入口点
支持通过 python -m kb_workflow 直接运行 CLI。
"""
from .cli import main
if __name__ == '__main__':
main()
@@ -9,11 +9,15 @@ KB Workflow - Knowledge Base Workflow Orchestrator
内部使用 kb_workflow.pipeline 包实现完整的内容处理流程。 内部使用 kb_workflow.pipeline 包实现完整的内容处理流程。
使用方式: 使用方式:
python kb_workflow.py process "https://www.bilibili.com/video/BVxxx" python -m kb_workflow process "https://www.bilibili.com/video/BVxxx"
python kb_workflow.py process "https://..." -o /path/to/output python -m kb_workflow process "https://..." -o /path/to/output
python kb_workflow.py login # QR code login python -m kb_workflow login # QR code login
python kb_workflow.py login --import-cookie cookies.json python -m kb_workflow login --import-cookie cookies.json
python kb_workflow.py login --status python -m kb_workflow login --status
或者通过包接口调用:
from kb_workflow import process_command
result = process_command("https://...")
""" """
import argparse import argparse
@@ -41,13 +45,13 @@ def process_command(
Dictionary with success status, content_dir, and results Dictionary with success status, content_dir, and results
""" """
try: try:
from kb_workflow.pipeline.config import get_settings from .pipeline.config import get_settings
from kb_workflow.pipeline.pipeline import Pipeline from .pipeline.pipeline import Pipeline
from kb_workflow.pipeline.processors import ( from .pipeline.processors import (
ASRProcessor, AnalyzeProcessor, ArchiveProcessor, ASRProcessor, AnalyzeProcessor, ArchiveProcessor,
DownloadProcessor, ParseProcessor DownloadProcessor, ParseProcessor
) )
from kb_workflow.pipeline.schemas import PipelineConfig from .pipeline.schemas import PipelineConfig
async def run_pipeline(): async def run_pipeline():
# Determine output directory - default to intermediate_path # Determine output directory - default to intermediate_path
@@ -119,9 +123,9 @@ def login_command(
Dictionary with login result Dictionary with login result
""" """
try: try:
from kb_workflow.auth import ZhihuLogin from .auth import ZhihuLogin
from kb_workflow.auth.cookie_manager import CookieManager, parse_json_cookies from .auth.cookie_manager import CookieManager, parse_json_cookies
from kb_workflow.pipeline.config import get_settings from .pipeline.config import get_settings
settings = get_settings() settings = get_settings()
manager = CookieManager() manager = CookieManager()
@@ -175,22 +179,22 @@ def main():
epilog=''' epilog='''
使用示例: 使用示例:
# 处理URL (通过完整管道) # 处理URL (通过完整管道)
python kb_workflow.py process "https://www.bilibili.com/video/BVxxx" python -m kb_workflow process "https://www.bilibili.com/video/BVxxx"
# 指定输出目录 # 指定输出目录
python kb_workflow.py process "https://..." -o /path/to/output python -m kb_workflow process "https://..." -o /path/to/output
# 强制重新执行(忽略已完成状态) # 强制重新执行(忽略已完成状态)
python kb_workflow.py process "https://..." --no-skip python -m kb_workflow process "https://..." --no-skip
# 知乎登录 (二维码扫码) # 知乎登录 (二维码扫码)
python kb_workflow.py login python -m kb_workflow login
# 导入 Cookie # 导入 Cookie
python kb_workflow.py login --import-cookie cookies.json python -m kb_workflow login --import-cookie cookies.json
# 检查 Cookie 状态 # 检查 Cookie 状态
python kb_workflow.py login --status python -m kb_workflow login --status
''' '''
) )
+1 -1
View File
@@ -54,7 +54,7 @@ class CrawlerConfig(BaseModel):
# Proxy settings # Proxy settings
proxy: Optional[ProxyConfig] = Field(None, description="Proxy configuration") proxy: Optional[ProxyConfig] = Field(None, description="Proxy configuration")
proxy_required: bool = Field(default=True, description="Whether proxy is mandatory") proxy_required: bool = Field(default=False, description="Whether proxy is mandatory (False for 旁路由 auto-proxy)")
# Rate limiting # Rate limiting
min_delay: float = Field(default=1.0, description="Minimum delay between requests (seconds)") min_delay: float = Field(default=1.0, description="Minimum delay between requests (seconds)")