Paramminer Cleanup / Update

[liquidsec]

No description provided.

[github-actions]

📊 Performance Benchmark Report

Comparing dev (baseline) vs paramminer-wordlist-cleanup (current)

📈 Detailed Results (All Benchmarks)

📋 Complete results for all benchmarks - includes both significant and insignificant changes

🧪 Test Name	📏 Base	📏 Current	📈 Change	🎯 Status
Bloom Filter Dns Mutation Tracking Performance	4.23ms	4.31ms	+1.8% ⚪	✅
Bloom Filter Large Scale Dns Brute Force	17.64ms	17.71ms	+0.4% ⚪	✅
Large Closest Match Lookup	336.18ms	329.03ms	-2.1% ⚪	✅
Realistic Closest Match Workload	178.73ms	176.85ms	-1.1% ⚪	✅
Event Memory Medium Scan	1784 B/event	1784 B/event	-0.0% ⚪	✅
Event Memory Large Scan	1768 B/event	1768 B/event	-0.0% ⚪	✅
Event Validation Full Scan Startup Small Batch	372.63ms	370.99ms	-0.4% ⚪	✅
Event Validation Full Scan Startup Large Batch	521.80ms	505.71ms	-3.1% ⚪	✅
Make Event Autodetection Small	25.42ms	25.32ms	-0.4% ⚪	✅
Make Event Autodetection Large	256.57ms	257.60ms	+0.4% ⚪	✅
Make Event Explicit Types	10.75ms	10.78ms	+0.3% ⚪	✅
Excavate Single Thread Small	3.410s	3.419s	+0.3% ⚪	✅
Excavate Single Thread Large	8.633s	8.657s	+0.3% ⚪	✅
Excavate Parallel Tasks Small	3.620s	3.601s	-0.5% ⚪	✅
Excavate Parallel Tasks Large	6.739s	6.758s	+0.3% ⚪	✅
Is Ip Performance	3.22ms	3.18ms	-1.5% ⚪	✅
Make Ip Type Performance	11.47ms	11.35ms	-1.0% ⚪	✅
Mixed Ip Operations	4.57ms	4.56ms	-0.1% ⚪	✅
Memory Use Web Crawl	51.2 MB	40.7 MB	-20.4% 🟢🟢🟢	🚀
Memory Use Subdomain Enum	19.4 MB	19.4 MB	+0.4% ⚪	✅
Scan Throughput 100	7.547s	7.188s	-4.8% ⚪	✅
Scan Throughput 1000	33.656s	34.607s	+2.8% ⚪	✅
Typical Queue Shuffle	63.08µs	60.41µs	-4.2% ⚪	✅
Priority Queue Shuffle	727.85µs	705.12µs	-3.1% ⚪	✅

🎯 Performance Summary

+ 1 improvement 🚀
  23 unchanged ✅

🔍 Significant Changes (>10%)

• Memory Use Web Crawl: 20.4% 🚀 less memory

---

🐍 Python Version 3.11.15

[codecov]

Codecov Report

❌ Patch coverage is 48.27586% with 30 lines in your changes missing coverage. Please review.
✅ Project coverage is 91%. Comparing base (45aa36c) to head (6f774c1).
⚠️ Report is 5 commits behind head on dev.

Files with missing lines	Patch %	Lines
bbot/modules/paramminer_getparams.py	41%	16 Missing ⚠️
bbot/modules/paramminer_headers.py	54%	14 Missing ⚠️

Additional details and impacted files

@@          Coverage Diff          @@
##             dev   #3067   +/-   ##
=====================================
- Coverage     91%     91%   -0%     
=====================================
  Files        437     437           
  Lines      37431   37482   +51     
=====================================
+ Hits       33874   33896   +22     
- Misses      3557    3586   +29     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.