Skip to content

v1.3.0 — Scope Engine v2, Rate-Limited & Resumable Recon Pipeline

Latest

Choose a tag to compare

@DevCop95 DevCop95 released this 19 Nov 06:29
· 1 commit to main since this release
7dc3c31

What's New in v1.3.0

Scope Engine v2 (scripts/scope_guard.py)

  • Granular Matching: Supports path-scoped URLs (/admin, /api/*, /logout* with path-boundary enforcement), explicit host:port rules, and label-glob wildcards (staging-*.example.com, *.api-*.example.com).
  • Governance & Freshness: Enforces program Status (Paused, Retired, Closed, Inactive, Archived block active scans while preserving global Out of Scope exclusions) and warns when Last scope review exceeds BB_SCOPE_MAX_AGE_DAYS (default 30).
  • Policy Parsing & Tooling: Extracts required research headers and Special Rules rate limits automatically, plus new CLI & bugbounty-hunter.sh commands:
    • scope-explain <target> (human & --json verdicts)
    • scope-audit (staleness, parse checks, and cross-program conflict detection)
    • scope-export <burp|json|txt|domains|wildcards|cidrs> (including Burp Suite advanced_mode JSON)
    • scope-import <file> <prog> (HackerOne CSV, bounty-targets-data / platform JSON, or TXT)
    • scope-diff <old> <new>

Resumable & Rate-Limited Pipeline (scripts/recon_utils.py, bugbounty/bugbounty-hunter.sh, auto-scanner/lib/common.sh)

  • Recon Utilities (scripts/recon_utils.py): parse-httpx (live_urls.txt, technologies.txt, takeover_candidates.txt), clean-urls (static-noise removal, structural URL deduplication, parameter extraction, and gf-style candidates_{xss,sqli,ssrf_redirect,lfi,idor}.txt), diff-baseline, and build-report.
  • Rate Limits & Checkpoints: Order-independent --passive-only, --resume, --fresh, and --rate-limit <N> flags; .state/*.done checkpoints in full mode; enforced rate limits across httpx, katana, nuclei, feroxbuster, and ffuf; HTTP timeouts on curl; and Nuclei -tags (cors, ssrf, redirect, idor) wired to live_urls.txt.
  • Integrations: Body credential redaction & browser_urls_in_scope.txt filtering in browser_capture.{js,sh}, offline scope-export in burp_api.py / burp.sh, IPv6 Cloudflare/Fastly edge detection in ip_cdn_owner(), and jq -n webhook formatting in kev-correlate.sh.

Quality & Verification

  • Added tests/test_recon_utils.py and expanded tests/test_scope_guard.py, tests/test_burp_api.py, tests/test-shell-scope.sh, and tests/test-pipeline-bugs.sh (27 Python unit tests, ShellCheck across all tracked .sh scripts, Node checks, Bash pipeline regression suite, and CI Lint, Security & Tests passing).