Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
87f30b4
First draft
nastasha-solomon Mar 21, 2025
4c90286
Formatting
nastasha-solomon Mar 21, 2025
0ea06a8
Some deduping
nastasha-solomon Mar 21, 2025
92eec84
Revisions
nastasha-solomon Mar 23, 2025
be56bea
New images
nastasha-solomon Mar 23, 2025
7f143d4
image updates
nastasha-solomon Mar 23, 2025
6dca5f3
Minor edits
nastasha-solomon Mar 23, 2025
95c75a9
em dash
nastasha-solomon Mar 23, 2025
6832d88
Moved more content around
nastasha-solomon Mar 23, 2025
852675d
Tweak
nastasha-solomon Mar 23, 2025
757b445
Grammar fix
nastasha-solomon Mar 23, 2025
4c39882
Missing space
nastasha-solomon Mar 24, 2025
ab551c6
Merge branch '8.x' into issue-287-6493-gaps-manul-runs
nastasha-solomon Mar 24, 2025
6076706
Update docs/detections/rules-ui-monitor.asciidoc
nastasha-solomon Mar 24, 2025
1edc175
Update docs/detections/rules-ui-monitor.asciidoc
nastasha-solomon Mar 24, 2025
b8d2aed
Update docs/detections/rules-ui-monitor.asciidoc
nastasha-solomon Mar 24, 2025
e3aabf8
Merge branch '8.x' into issue-287-6493-gaps-manul-runs
nastasha-solomon Mar 24, 2025
667bac0
Merge branch '8.x' into issue-287-6493-gaps-manul-runs
nastasha-solomon Mar 24, 2025
966be56
Merge branch '8.x' into issue-287-6493-gaps-manul-runs
nastasha-solomon Mar 25, 2025
90c387b
Update docs/detections/rules-ui-monitor.asciidoc
nastasha-solomon Mar 25, 2025
7fd1a84
Merge branch '8.x' into issue-287-6493-gaps-manul-runs
nastasha-solomon Mar 25, 2025
18fb564
Update docs/detections/rules-ui-manage.asciidoc
nastasha-solomon Mar 27, 2025
b913a09
Update docs/detections/rules-ui-monitor.asciidoc
nastasha-solomon Mar 27, 2025
0857cf3
Feedback from technical review
nastasha-solomon Mar 27, 2025
6bb3c7f
Update docs/detections/rules-ui-monitor.asciidoc
nastasha-solomon Mar 28, 2025
fad37f1
Update docs/detections/rules-ui-manage.asciidoc
nastasha-solomon Mar 28, 2025
1a3a943
Kseniia's feedback
nastasha-solomon Mar 28, 2025
3948936
One more change
nastasha-solomon Mar 28, 2025
d8a9eb0
revert changes
nastasha-solomon Mar 28, 2025
d33fd45
uppercase
nastasha-solomon Mar 28, 2025
7a71cca
Merge branch '8.x' into issue-287-6493-gaps-manul-runs
nastasha-solomon Mar 28, 2025
7cd3ad8
Table name
nastasha-solomon Mar 28, 2025
4c897b2
Merge branch '8.x' into issue-287-6493-gaps-manul-runs
nastasha-solomon Mar 28, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file added docs/detections/images/gaps-table.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/detections/images/manual-rule-run-table.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/detections/images/monitor-table.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
15 changes: 7 additions & 8 deletions docs/detections/rules-ui-manage.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -109,9 +109,7 @@ NOTE: When duplicating a rule with exceptions, you can choose to duplicate the r
[[manually-run-rules]]
=== Run rules manually

beta::[]

Manually run enabled rules for a specified period of time for testing purposes or additional rule coverage.
Manually run enabled rules for a specified period of time to deliberately test them, provide additional rule coverage, or fill gaps in rule executions.

IMPORTANT: Before manually running rules, make sure you properly understand and plan for rule dependencies. Incorrect scheduling can lead to inconsistent rule results.

Expand All @@ -121,18 +119,19 @@ IMPORTANT: Before manually running rules, make sure you properly understand and
* Select all the rules you want to manually run, select the **Bulk actions** menu, then select **Manual run**.
. Specify when the manual run starts and ends. The default selection is the current day starting three hours in the past. The rule will search for events during the selected time range.
. Click **Run** to manually run the rule.
+
NOTE: Manual runs can produce multiple rule executions. This is determined by the manual run's time range and the rule's execution schedule.

The manual run's details are shown in the <<manual-runs-table,Manual runs>> table on the *Execution results* tab. Changes you make to the manual run or rule settings will display in the Manual runs table after the current run completes.
The rule will run over the time range that you selected. Note that all <<rule-notifications,rule actions>> will also be activated, except for **Summary of alerts** actions that run at a custom frequency.

Go to the <<manual-runs-table>> on the **Execution results** tab to track the manual rule executions. If you manually ran the rule over a gap, you can also monitor the gap fill's progress from the <<gaps-table>>.

[NOTE]
=====
Be mindful of the following:

* Rule actions are not activated during manual runs.
* Any changes that you make to the manual run or rule settings will display in the Manual runs table after the current run completes.
* Except for threshold rules, duplicate alerts aren't created if you manually run a rule during a time range that was already covered by a scheduled run.
* Manual runs are executed with low priority and limited concurrency, meaning they might take longer to complete. This can be especially apparent for rules requiring multiple executions.
* Manually running a custom query rule with suppression may incorrectly inflate the number of suppressed alerts.

=====

[float]
Expand Down
73 changes: 53 additions & 20 deletions docs/detections/rules-ui-monitor.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -20,8 +20,7 @@ Refer to the <<troubleshoot-signals>> section below for strategies on adjusting
[[rule-monitoring-tab]]
=== Rule Monitoring tab

To view a summary of all rule executions, including the most recent failures and execution
times, select the *Rule Monitoring* tab on the *Rules* page. To access the tab, find **Detection rules (SIEM)** in the navigation menu or look for “Detection rules (SIEM)” using the {kibana-ref}/introduction.html#kibana-navigation-search[global search field], then go to the *Rule Monitoring* tab.
To view a summary of all rule executions (including the most recent failures, execution times, and gaps in rule executions), select the *Rule Monitoring* tab on the *Rules* page. To access the tab, find **Detection rules (SIEM)** in the navigation menu or look for “Detection rules (SIEM)” using the {kibana-ref}/introduction.html#kibana-navigation-search[global search field], then go to the *Rule Monitoring* tab.

[role="screenshot"]
image::images/monitor-table.png[]
Expand All @@ -32,18 +31,28 @@ TIP: To sort the rules list, click any column header. To sort in descending orde

For detailed information on a rule, the alerts it generated, and associated errors, click on its name in the table. This also allows you to perform the same actions that are available on the <<rules-ui-management, **Installed Rules** tab>>, such as modifying or deleting rules, activating or deactivating rules, exporting or importing rules, and duplicating prebuilt rules.

For information about rule execution gaps (which are periods of time when a rule didn't run), use the panel above the table. The time filter on the left allows you to select a time range for viewing gap data. The **Total rules with gaps:** field tells you how many rules have unfilled or partially filled gaps within the selected time range. The **Only rules with gaps** filter on the right lets you only display rules with unfilled or partially filled gaps.

Within the table, the **Last Gap (if any)** column conveys how long the most recent gap for a rule lasted. The **Unfilled gaps duration** column shows whether a rule still has gaps and provides a total sum of the remaining unfilled or partially filled gaps. The total sum can change based on the time range that you select in the panel above the table. If a rule has no gaps, the columns display a dash (`––`).

TIP: For a detailed view of a rule's gaps, go to the **Execution results** tab and check the <<gaps-table>>.

[float]
[[rule-execution-logs]]
=== Execution results
=== Execution results tab

Each detection rule execution is logged, including the execution type, the execution's success or failure, any warning or error messages, how long it took to search for data, create alerts, and complete. This can help you troubleshoot a particular rule if it isn't behaving as expected (for example, if it isn't creating alerts or takes a long time to run).
From the **Execution results** tab, you can access the rule’s execution log, monitor and address gaps in a rule's execution schedule, and check manual runs for the rule. To find the tab, click the rule's name to open its details, then scroll down.

To access a rule's execution log, click the rule's name to open its details, then scroll down and select the **Execution results** tab. Within the Execution log table, you can click the arrow at the end of a row to expand a long warning or error message.
[float]
[[execution-results-tab]]
==== Execution log table

Each detection rule execution is logged, including the execution type, the execution's success or failure, any warning or error messages, how long it took to search for data, create alerts, and complete. This can help you troubleshoot a particular rule if it isn't behaving as expected (for example, if it isn't creating alerts or takes a long time to run).

[role="screenshot"]
image::images/rule-execution-logs.png[Execution log table on the rule execution results tab]

You can hover over each column heading to display a tooltip about that column's data. Click a column heading to sort the table by that column.
You can hover over each column heading to display a tooltip about that column's data. Click a column heading to sort the table by that column. Within the Execution log table, you can click the arrow at the end of a row to expand a long warning or error message.

Use these controls to filter what's included in the logs table:

Expand All @@ -65,32 +74,56 @@ Use these controls to filter what's included in the logs table:
* The *Actions* column allows you to show alerts generated from a given rule execution. Click the filter icon (image:images/filter-icon.png[Filter icon,18,17]) to create a global search filter based on the rule execution's ID value. This replaces any previously applied filters, changes the global date and time range to 24 hours before and after the rule execution, and displays a confirmation notification. You can revert this action by clicking *Restore previous filters* in the notification.

[float]
[[manual-runs-table]]
==== Manual runs table
[[gaps-table]]
==== Gaps table

beta::[]

Each manual run can produce multiple rule executions, depending on the time range of the run and the rule's execution schedule. These details are shown in the Manual runs table.
Gaps in rule executions are periods of time where a rule didn’t run. They can be caused by various disruptions, including system updates, rule failures, or simply turning off a rule. Addressing gaps is essential for maintaining consistent coverage and avoiding missed alerts.

To access the table, navigate to the detection rules page, click the rule's name to open its details, then scroll down and select the **Execution results** tab. Scroll down again to find the Manual runs table.
TIP: Refer to the <<troubleshoot-gaps>> section for strategies for avoiding gaps.

To stop an active run, go to the appropriate row and click **Stop run** in the **Actions** column. Completed rule executions for each manual run are logged in the Execution log table.
Use the information in the Gaps table to assess the scope and severity of rule execution gaps. To control what's shown in the table, you can filter the table by gap status, select a time range for viewing gap data, and sort multiple columns.

[role="screenshot"]
image::images/manual-rule-run-table.png[Manual rule runs table on the rule execution results tab]
image::images/gaps-table.png[Gaps table on the rule execution results tab]

The Manual runs table displays important details such as:
The Gaps table has the following columns:

* The status of each manual run:
** **Pending**: The rule is not yet running.
** **Running**: The rule is executing during the time range you specified. Some rules, such as indicator match rules, can take longer to run.
** **Error**: The rule's configuration is preventing it from running correctly. For example, the rule's conditions cannot be validated.
* **Status**: The current state of the gap. It can be `Filled`, `Partially filled`, or `Unfilled`.
* **Detected at**: The date and time the gap was first discovered.
* **Manual fill tasks**: The status of the manual run that’s filling the gap. For more details about the manual run, refer to its entry in the <<manual-runs-table,Manual runs table>>.
* **Event time covered**: How much progress the manual run has made filling the gap.
+
NOTE: If you stop a manual run that hasn't finished filling a gap, the gap’s status will be set to `Partially filled`. To fill the remaining gap, you can select the **Fill remaining gap** action or <<manually-run-rules,manually run>> the rule over the gap's time frame.
+
* **Range**: When the gap started and ended.
* **Total gap duration**: How long the gap lasted.
* **Actions**: The actions that you can take for the gap. They can be **Fill gap** (starts a manual run to fill the gap) or **Fill remaining gap** (starts a manual run that fills the leftover portion of the gap).

* When a manual run started and the time in which it will run
[float]
[[manual-runs-table]]
==== Manual runs table

You can <<manually-run-rules,manually run>> enabled rules for a specified period of time to deliberately test them, provide additional rule coverage, or fill gaps in rule executions. Each manual run can produce multiple rule executions, depending on the time range of the run and the rule's execution schedule.

NOTE: Manual runs are executed with low priority and limited concurrency, meaning they might take longer to complete. This can be especially apparent for rules requiring multiple executions.

* The number of rule executions that are failing, pending, running, and completed for a manual run
The Manual runs table tracks manual rule executions and provides important details such as:

* The total number of rule executions that the manual run will produce and how many are failing, pending, running, and completed.
* When the manual run started and the time range that it will cover.
+
NOTE: To stop an active run, go to the appropriate row in the table and click **Stop run** in the **Actions** column. Completed rule executions for each manual run are logged in the Execution log table.
+
* The status of each manual run:
** `Pending`: The rule is not yet running.
** `Running`: The rule is executing during the time range you specified. Some rule types, such as indicator match rules, can take longer to run.
** `Error`: The rule's configuration is preventing it from running correctly. For example, the rule's conditions cannot be validated.

[role="screenshot"]
image::images/manual-rule-run-table.png[Manual rule runs table on the rule execution results tab]

* The total number of rule executions that are occurring for a manual run

[float]
[[troubleshoot-signals]]
Expand Down