Skip to content

Conversation

w0rk3r
Copy link
Contributor

@w0rk3r w0rk3r commented Sep 11, 2025

Issues

Part of github.com/elastic/ia-trade-team/issues/678

Summary

Converts rules to use new_terms to reduce noise.

@w0rk3r w0rk3r self-assigned this Sep 11, 2025
@w0rk3r w0rk3r added Rule: Tuning tweaking or tuning an existing rule OS: Windows windows related rules Domain: Endpoint backport: auto labels Sep 11, 2025
Copy link
Contributor

Rule: Tuning - Guidelines

These guidelines serve as a reminder set of considerations when tuning an existing rule.

Documentation and Context

  • Detailed description of the suggested changes.
  • Provide example JSON data or screenshots.
  • Provide evidence of reducing benign events mistakenly identified as threats (False Positives).
  • Provide evidence of enhancing detection of true threats that were previously missed (False Negatives).
  • Provide evidence of optimizing resource consumption and execution time of detection rules (Performance).
  • Provide evidence of specific environment factors influencing customized rule tuning (Contextual Tuning).
  • Provide evidence of improvements made by modifying sensitivity by changing alert triggering thresholds (Threshold Adjustments).
  • Provide evidence of refining rules to better detect deviations from typical behavior (Behavioral Tuning).
  • Provide evidence of improvements of adjusting rules based on time-based patterns (Temporal Tuning).
  • Provide reasoning of adjusting priority or severity levels of alerts (Severity Tuning).
  • Provide evidence of improving quality integrity of our data used by detection rules (Data Quality).
  • Ensure the tuning includes necessary updates to the release documentation and versioning.

Rule Metadata Checks

  • updated_date matches the date of tuning PR merged.
  • min_stack_version should support the widest stack versions.
  • name and description should be descriptive and not include typos.
  • query should be inclusive, not overly exclusive. Review to ensure the original intent of the rule is maintained.

Testing and Validation

  • Validate that the tuned rule's performance is satisfactory and does not negatively impact the stack.
  • Ensure that the tuned rule has a low false positive rate.

@tradebot-elastic
Copy link

tradebot-elastic commented Sep 11, 2025

⛔️ Test failed

Results
  • ❌ LSASS Memory Dump Handle Access (kuery)
    • stack_validation_failed: no_alerts - 0 alerts
  • ❌ Web Shell Detection: Script Process Child of Common Web Processes (kuery)
    • coverage_issue: no_rta
    • stack_validation_failed: no_rta
  • ✅ Execution via MSSQL xp_cmdshell Stored Procedure (kuery)
  • ❌ Potential Credential Access via DCSync (kuery)
    • coverage_issue: no_rta
    • stack_validation_failed: no_rta
  • ✅ Unusual File Operation by dns.exe (kuery)

@tradebot-elastic
Copy link

tradebot-elastic commented Sep 11, 2025

⛔️ Test failed

Results
  • ❌ LSASS Memory Dump Handle Access (kuery)
    • stack_validation_failed: no_alerts - 0 alerts
  • ❌ Web Shell Detection: Script Process Child of Common Web Processes (kuery)
    • coverage_issue: no_rta
    • stack_validation_failed: no_rta
  • ✅ Execution via MSSQL xp_cmdshell Stored Procedure (kuery)
  • ❌ Potential Credential Access via DCSync (kuery)
    • coverage_issue: no_rta
    • stack_validation_failed: no_rta
  • ✅ Unusual File Operation by dns.exe (kuery)

@tradebot-elastic
Copy link

tradebot-elastic commented Sep 11, 2025

⛔️ Test failed

Results
  • ❌ LSASS Memory Dump Handle Access (kuery)
    • stack_validation_failed: no_alerts - 0 alerts
  • ❌ Web Shell Detection: Script Process Child of Common Web Processes (kuery)
    • coverage_issue: no_rta
    • stack_validation_failed: no_rta
  • ✅ Execution via MSSQL xp_cmdshell Stored Procedure (kuery)
  • ❌ Potential Credential Access via DCSync (kuery)
    • coverage_issue: no_rta
    • stack_validation_failed: no_rta
  • ✅ Unusual File Operation by dns.exe (kuery)

@w0rk3r w0rk3r requested a review from Samirbous September 12, 2025 11:05
@tradebot-elastic
Copy link

tradebot-elastic commented Sep 12, 2025

⛔️ Test failed

Results
  • ❌ LSASS Memory Dump Handle Access (kuery)
    • stack_validation_failed: no_alerts - 0 alerts
  • ❌ Web Shell Detection: Script Process Child of Common Web Processes (kuery)
    • coverage_issue: no_rta
    • stack_validation_failed: no_rta
  • ❌ Execution via MSSQL xp_cmdshell Stored Procedure (kuery)
    • stack_validation_failed: no_alerts - 0 alerts
  • ❌ Potential Credential Access via DCSync (kuery)
    • coverage_issue: no_rta
    • stack_validation_failed: no_rta
  • ✅ Unusual File Operation by dns.exe (kuery)

@tradebot-elastic
Copy link

tradebot-elastic commented Sep 12, 2025

⛔️ Test failed

Results
  • ❌ LSASS Memory Dump Handle Access (kuery)
    • stack_validation_failed: no_alerts - 0 alerts
  • ❌ Web Shell Detection: Script Process Child of Common Web Processes (kuery)
    • coverage_issue: no_rta
    • stack_validation_failed: no_rta
  • ❌ Execution via MSSQL xp_cmdshell Stored Procedure (kuery)
    • stack_validation_failed: no_alerts - 0 alerts
  • ❌ Potential Credential Access via DCSync (kuery)
    • coverage_issue: no_rta
    • stack_validation_failed: no_rta
  • ✅ Unusual File Operation by dns.exe (kuery)

@w0rk3r w0rk3r requested a review from Samirbous September 12, 2025 21:13
@tradebot-elastic
Copy link

tradebot-elastic commented Sep 15, 2025

⛔️ Test failed

Results
  • ❌ LSASS Memory Dump Handle Access (kuery)
    • stack_validation_failed: no_alerts - 0 alerts
  • ❌ Web Shell Detection: Script Process Child of Common Web Processes (kuery)
    • coverage_issue: no_rta
    • stack_validation_failed: no_rta
  • ❌ Execution via MSSQL xp_cmdshell Stored Procedure (kuery)
    • stack_validation_failed: no_alerts - 0 alerts
  • ❌ Potential Credential Access via DCSync (kuery)
    • coverage_issue: no_rta
    • stack_validation_failed: no_rta
  • ✅ Unusual File Operation by dns.exe (kuery)

@w0rk3r w0rk3r merged commit 4476ac5 into main Sep 15, 2025
12 checks passed
@w0rk3r w0rk3r deleted the rule_review_1 branch September 15, 2025 16:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport: auto Domain: Endpoint OS: Windows windows related rules Rule: Tuning tweaking or tuning an existing rule
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants