Repository navigation
v1.5.0
🚀 新增功能
- 统一多协议代理池与三域分流调度:新增
proxy_service.py、osint_service/proxy_router.py与ProxyManagePanel.vue,支持http/https/socks5/socks5h节点池管理及scan(扫描探针)、osint(企业测绘)、intel(威胁情报与模板同步)三域独立策略(direct_only、fixed_proxy、failover、round_robin)、内网 CIDR/国内 Webhook/自定义NO_PROXY旁路白名单与行内多预设探针测活;抽取proxyStatus.js统一全站 5 态出口运行态展示。 - Nuclei 漏洞独立推送、自建模板 ASM 多协议分流与在线单目标调试:新增
nuclei_vuln独立推送开关与nuclei_push_severities严重级别过滤,统一收口于任务终态落库后分发;自建模板接入 ASM 多协议分桶(web/network/dns),支持纯自建模板策略(include_community=False)、社区与自建通道隔离执行及template_source来源溯源;补齐在线单目标即时调试(/api/nuclei/template/test/)与任务列表独立 Nuclei 漏洞统计胶囊。 - 端口扫描存活探测策略与任务/策略级站点截图开关(
site_capture):端口扫描新增host_discovery_mode(auto自适应决策矩阵 /skip强制-Pn/probe强制存活探测);新增任务与策略级site_capture站点截图开关(缺省默认开启,关闭时跳过无头浏览器截图,开启时自动剔除catch_all_sites默认后端),并在SyncAsset、monitor_diff与DeleteTask中实现存量站点截图防降级与物理截图引用保护。 - 企业 OSINT 测绘批量停止、断点续跑、原位详情补全与快应用维度:新增
/api/icp/batch_stop/、/api/icp/resume/与/api/icp/backfill_details/接口及前端工作流;支持快应用(kapp)维度采集、跨源(tyc+icp)合并去重与自适应动态列展示。 - GitHub 监控研判去重链路与 MCP 全链路工具治理升级:新增
github_triage.py、/api/github_result/*研判状态流转、噪音仓库屏蔽列表、CSV 导出、周期策略手动触发及内置正则阅读器GithubCodeReader.vue;MCP 中心统一/api/mcp/tools、search_assets、task_status、create_scan_task、stop_scan_task五项工具治理接口、Scope 权限开关与双副本 Stdio 桥接脚本。
🛠️ 性能与重构
- 系统设置五域胶囊架构与离开防护重构:重构
SystemSettings.vue为五大渗透工作流分区,建立SECTION_SPECS/dirtySections脏状态单一事实源与三选一路由离开确认弹窗(留在本页 / 放弃修改并离开 / 保存全部并离开);移除冗余凭据状态条、高级扫描页代理占位卡与废弃/merged_general接口;统一多列表页右上角「新建」主按钮位置与三语动词口径。 - 企业测绘分页进度心跳、逐页落库与有界详情补全:
job_runner.py与ymicp.py实现分页采集进度心跳日志、逐页增量落库与单批有界详情补全(detail_max_items=100),降低长耗时任务中断导致的数据丢失风险并支持事后原位全量补全。
🐛 问题修复与加固
- OSINT 多出口隔离、断点续跑清理与崩溃自愈加固:
run_tyc_job为天眼查与工信部拆分独立service_scope冷却路由器并共享进程级物理出口限速锁;blocked_exits改为 MongoDB 点路径原子更新;run_icp_job续跑前自动清理未完成维度半成品记录并在完成时标记recon_checkpoint.completed=True;reconcile_orphan_tasks与_schedule_abort同步清理残留detail_backfill_running锁并恢复原终态;加固ymicp无验证码分支、详情 WAF 冷却计算、并发detail_context快照隔离、天眼查403/429切备及_stop_single_icp_task停止失败重试;隔离资产组主体资产更新状态(updating_icp_task_id/last_update_error)。 - 生产部署脚本 systemd 219 兼容与系统更新日志缓存修复:修复
start-prod.sh在 CentOS 7systemd 219下systemctl show不支持--value导致MainPID提取失败及 8888 端口自更新服务误杀问题;修复SystemUpdatePanel.vue与/api/system_config/check_update空更新日志框、跨 Worker 共享缓存及双语回退。 - 前端 KeepAlive 生命周期与通知完整性修复:修复
SystemSettings.vue、ProxyManagePanel.vue、McpCenter.vue、GithubManage.vue在 KeepAlive 切页下的全局监听/定时器清理、放弃修改表单重置与后台轮询恢复;对齐CdnRulePanel.vue删除确认文案与即时持久化行为;sync_asset自动回填task_name并在nuclei_only_fallback路径兜底发送任务完成汇总。
🛡️ 安全与配置
- Nuclei 参数白名单、多协议模板校验与在线调试 SSRF 防护:在
/api/task/、/api/policy/*与NucleiScan中强制校验nuclei_config.severity白名单;自建模板静态校验与 ASM 分桶遍历全部协议块以拦截包含code/headless/file/workflows的复合模板;在线单目标调试默认阻断本机回环、云元数据(169.254.169.254)、容器内部服务名并复用BLACK_IPS/FORBIDDEN_DOMAINS;含认证代理改经0o600临时文件下发并在CalledProcessError中脱敏;社区模板目录边界校验改用os.path.commonpath并启用 ZIP 同步 TLS 证书校验。 - 代理凭据脱敏、GitHub 雷达参数校验与 MCP 边界加固:
GET /api/system_config/general与run_recon_job日志全面脱敏代理口令与天眼查 Token;OSINT 域fixed_proxy无启用节点时严格 Fail-Closed 拒绝回退直连;github_threat删除与配置接口补充字符串类型及interval范围校验;MCPMCPTaskDetailExport钳制分页参数、SSE 优先采信X-Real-IP且忽略Basic认证头遮蔽、Stdio 桥接在拉取工具清单异常时安全降级为只读工具集;同步更新中英文README、docs/QUICKSTART*.md、docs/API_GUIDE*.md与mcp-server文档。
🚀 New Features
- Unified multi-protocol proxy pool and three-domain traffic routing: added
proxy_service.py,osint_service/proxy_router.py, andProxyManagePanel.vuesupportinghttp/https/socks5/socks5hproxy nodes with independent routing policies (direct_only,fixed_proxy,failover,round_robin) acrossscan,osint, andinteldomains, private CIDR / domestic webhook / customNO_PROXYbypass rules, and per-row multi-preset liveness probing; centralized 5-state egress status labels inproxyStatus.js. - Dedicated Nuclei vulnerability push, custom template ASM multi-protocol routing, and online dry-run debugging: added the
nuclei_vulnpush channel andnuclei_push_severitiesfiltering dispatched after terminal task state persistence; routed custom templates across ASMweb,network, anddnsbuckets with support for custom-only policies (include_community=False), isolated community vs. custom execution channels, andtemplate_sourceprovenance tracking; added online single-target dry-run debugging (/api/nuclei/template/test/) and a standalone Nuclei vulnerability capsule inTaskList.vue. - Port-scan host discovery modes and task/policy website screenshot toggle (
site_capture): introduced configurablehost_discovery_mode(autoadaptive matrix /skip-Pn/probeforced discovery); added thesite_capturetoggle across tasks, policies, and presets (enabled by default for backward compatibility, skipping headless browser capture when disabled and excludingcatch_all_sitesdefault backends when enabled) with existing asset-group screenshot preservation inSyncAsset, empty-screenshot diff suppression inmonitor_diff, and reference-checked cleanup inDeleteTask. - Enterprise OSINT batch stop, checkpoint resume, in-place detail backfill, and fast-app (
kapp) support: added/api/icp/batch_stop/,/api/icp/resume/, and/api/icp/backfill_details/endpoints and UI workflows; added fast-app (kapp) discovery, cross-source (tyc+icp) deduplication and merging, and adaptive dynamic table columns. - GitHub monitor triage deduplication workflow and MCP full-lifecycle tool governance: added
github_triage.py,/api/github_result/*triage status management, noisy-repository ignore lists, CSV export, manual scheduler triggers, and theGithubCodeReader.vuecode viewer; expanded MCP governance with/api/mcp/tools,search_assets,task_status,create_scan_task, andstop_scan_taskendpoints, scope switches, and synchronized Stdio bridge scripts.
🛠️ Performance & Refactoring
- System Settings five-domain capsule architecture and route-leave guard overhaul: redesigned
SystemSettings.vueinto five workflow domains with a unifiedSECTION_SPECS/dirtySectionsregistry and a 3-choice leave confirmation modal (Stay / Discard & leave / Save all & leave); removed redundant credential banners, proxy placeholder cards, and the legacy/merged_generalendpoint; unified top-right primary create button placement and trilingual action verb copy across list views. - Paginated OSINT progress heartbeats, incremental persistence, and bounded detail enrichment: updated
job_runner.pyandymicp.pywith per-page progress heartbeats, incremental page persistence, and bounded per-batch detail enrichment (detail_max_items=100) paired with on-demand full backfill.
🐛 Bug Fixes & Hardening
- OSINT multi-exit isolation, checkpoint resume cleanup, and crash recovery: isolated TYC vs. MIIT cooldown scopes in
run_tyc_jobwhile sharing process-wide per-exit rate-limit locks; switchedblocked_exitspersistence to atomic MongoDB dot-key updates; cleaned partial uncompleted dimensions before resumingrun_icp_joband setrecon_checkpoint.completed=Trueupon completion; cleared staledetail_backfill_runninglocks and restored prior terminal statuses inreconcile_orphan_tasksand_schedule_abort; hardenedymicpnon-captcha detail failover, detail WAF cooldown estimation, concurrentdetail_contextsnapshots, TYC403/429failover,_stop_single_icp_taskretryability, and asset-group organization update state isolation. - Production deployment
systemd 219compatibility and release notes cache fix: fixedMainPIDextraction without--valueand added 3-layer port 8888 updater self-kill protection instart-prod.shon CentOS 7 (systemd 219); fixed empty release notes rendering, cross-worker shared caching, and bilingual fallback inSystemUpdatePanel.vueand/api/system_config/check_update. - Frontend KeepAlive lifecycle and notification completeness fixes: fixed global listener and timer cleanup, discard-and-leave state resets, and background polling resumption across
SystemSettings.vue,ProxyManagePanel.vue,McpCenter.vue, andGithubManage.vueunder<keep-alive>; alignedCdnRulePanel.vuedelete confirmation copy with instant persistence; auto-populatedtask_nameinsync_assetand emitted task completion summaries onnuclei_only_fallback.
🛡️ Security & Configuration
- Nuclei argument allowlisting, multi-protocol template validation, and dry-run SSRF guards: enforced strict
nuclei_config.severityallowlists across/api/task/,/api/policy/*, andNucleiScan; inspected all YAML protocol blocks to prevent hybrid templates containingcode/headless/file/workflowsfrom bypassing ASM or dry-run restrictions; blocked loopback, cloud metadata (169.254.169.254), and internal container hostnames in online dry-run while respectingBLACK_IPS/FORBIDDEN_DOMAINS; passed authenticated proxies via0o600temporary files and maskedCalledProcessErrorcommands; switched community template path checks toos.path.commonpathand re-enabled TLS verification for template ZIP downloads. - Proxy credential redaction, GitHub radar input validation, and MCP boundary hardening: masked proxy credentials and TYC tokens in
GET /api/system_config/generalandrun_recon_joblogs; enforced fail-closed behavior for OSINTfixed_proxywhen bound nodes are disabled; validated string payloads andintervalbounds ingithub_threatendpoints; clamped pagination inMCPTaskDetailExport, prioritizedX-Real-IPand ignoredBasicauth header shadowing in MCP SSE, and downgraded Stdio bridge tool lists to read-only tools on remote sync errors; synchronized bilingualREADME,docs/QUICKSTART*.md,docs/API_GUIDE*.md, andmcp-serverdocumentation.
Full Changelog: v1.4.6...v1.5.0