Skip to content

Entity Analytics 9.4 updates for UEBA integrations#17626

Open
jmcarlock wants to merge 35 commits intomainfrom
ueba-9.4-euid-update
Open

Entity Analytics 9.4 updates for UEBA integrations#17626
jmcarlock wants to merge 35 commits intomainfrom
ueba-9.4-euid-update

Conversation

@jmcarlock
Copy link
Copy Markdown
Contributor

@jmcarlock jmcarlock commented Mar 2, 2026

Proposed commit message

Updates UEBA packages for Entity Analytics in the 9.4 release.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.
  • I have verified that any added dashboard complies with Kibana's Dashboard good practices

How to test this PR locally

Test with ITP

@jmcarlock jmcarlock added the enhancement New feature or request label Mar 2, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Mar 2, 2026

Vale Linting Results

Summary: 1 warning, 9 suggestions found

⚠️ Warnings (1)
File Line Rule Message
packages/ded/docs/README.md 83 Elastic.Latinisms Latin terms and abbreviations are a common source of confusion. Use 'using' instead of 'via'.
💡 Suggestions (9)
File Line Rule Message
packages/ded/docs/README.md 37 Elastic.WordChoice Consider using 'refer to if it's a document, view if it's a UI element' instead of 'See', unless the term is in the UI.
packages/ded/docs/README.md 52 Elastic.Wordiness Consider using 'if' instead of 'In the event that'.
packages/dga/docs/README.md 84 Elastic.Repetition "Detection" is repeated.
packages/lmd/docs/README.md 46 Elastic.WordChoice Consider using 'refer to if it's a document, view if it's a UI element' instead of 'See', unless the term is in the UI.
packages/lmd/docs/README.md 76 Elastic.Clone Use Clone only when referring to cloning a GitHub repository or creating a copy that is linked to the original. Often confused with 'copy' and 'duplicate'.
packages/pad/docs/README.md 96 Elastic.Wordiness Consider using 'if' instead of 'In the event that'.
packages/problemchild/docs/README.md 16 Elastic.WordChoice Consider using 'refer to if it's a document, view if it's a UI element' instead of 'see', unless the term is in the UI.
packages/problemchild/docs/README.md 124 Elastic.WordChoice Consider using 'refer to if it's a document, view if it's a UI element' instead of 'See', unless the term is in the UI.
packages/problemchild/docs/README.md 126 Elastic.Repetition "Detection" is repeated.

The Vale linter checks documentation changes against the Elastic Docs style guide.

To use Vale locally or report issues, refer to Elastic style guide for Vale.

@andrewkroh andrewkroh added documentation Improvements or additions to documentation. Applied to PRs that modify *.md files. Integration:ded Data Exfiltration Detection Integration:lmd Lateral Movement Detection Integration:dga Domain Generation Algorithm Detection Integration:pad Privileged Access Detection Integration:problemchild Living off the Land Attack Detection dashboard Relates to a Kibana dashboard bug, enhancement, or modification. labels Mar 3, 2026
@andrewkroh andrewkroh added the Integration:hta Host Traffic Anomalies label Mar 3, 2026
@jmcarlock jmcarlock changed the title Add EUIDs to UEBA integrations Entity Analytics 9.4 updates for UEBA integrations Mar 9, 2026
Copy link
Copy Markdown
Contributor

@sodhikirti07 sodhikirti07 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jmcarlock Thanks for making the changes. I've left a few comments around documentation and adding fields to the transforms. Other are some minor changes.

Copy link
Copy Markdown
Member

@andrewkroh andrewkroh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was giving this a quick look and noticed a pre-existing issue with ECS event.kind in the problemchild pipeline. It makes the event.kind into an array, but in ECS this is a scalar field. So instead of append processors those should be set. It's pre-existing, so feel free to ignore this if you don't want to address it now. I can open an issue for it if you'd like. See

https://github.com/elastic/integrations/wiki/Fleet-Package-Code-Review-Comments#pipeline-on_failure-handler-must-set-eventkind-pipeline_error

@jmcarlock
Copy link
Copy Markdown
Contributor Author

@andrewkroh Thank you for the review! This was an easy fix so I added it here

@jmcarlock jmcarlock requested a review from peteharverson March 19, 2026 14:31
@jmcarlock
Copy link
Copy Markdown
Contributor Author

@rylnd @abhishekbhatia1710 @dplumlee Along with the PR in Kibana, could you also review this PR for changes relevant to your team? 🙏

@jmcarlock jmcarlock requested review from ymao1 March 19, 2026 15:27
@jmcarlock jmcarlock requested a review from uri-weisman March 19, 2026 16:03
Copy link
Copy Markdown
Contributor

@peteharverson peteharverson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes to the ML jobs LGTM

@susan-shu-c
Copy link
Copy Markdown
Member

susan-shu-c commented Mar 25, 2026

Hi Gus, let's consider cherry-picking the relevant commits from #18038 so that users don't get too many version bumps at once (as opposed to if we merged that PR and this one too)

Convert bold list items to headings so #enable-detection-rules and
#enabling-detection-rules anchors resolve in docs-builder.

Affects: ded, dga, lmd, problemchild

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@theletterf
Copy link
Copy Markdown
Member

@susan-shu-c Brought the docs changes in c196362

@jmcarlock jmcarlock requested a review from andrewkroh March 25, 2026 15:15
Resolve merge conflicts in changelog.yml, manifest.yml, and transform.yml
files across ded, dga, hta, lmd, pad, and problemchild packages. Keeps
branch version numbers and incorporates main's recent changelog entries.
Copy link
Copy Markdown

@kapral18 kapral18 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

DED and LMD changes look correct — job IDs, transforms, fields, dashboards, and docs are all internally consistent.

The PAD package has four issues:

  1. Functional bug: The Windows dashboard searchSourceJSON query lists 8 job IDs but omits pad_windows_rare_region_name_by_user_ea, so anomalies from that job are silently filtered from all Lens panels (only the swim lane shows them).
  2. Copy-paste error: The Windows dashboard swimlane panelTitle references Linux job names.
  3. Doc typo: The Anomaly Detection Jobs table lists pad_okta_spike_in_group_application_assignment_change but the actual job ID is pad_okta_spike_in_group_application_assignment_changes_ea (missing trailing s and _ea suffix).
  4. Doc error: pad_linux_high_median_process_command_line_entropy_by_user_ea is listed with "Okta Integration" as the supported platform — should be "Linux".

Everything else (transform field additions, ML module renames, changelog/manifest bumps) is clean across all three packages.

@jmcarlock
Copy link
Copy Markdown
Contributor Author

jmcarlock commented Mar 26, 2026

This will be merged closer to Kibana release as integrations are independent this schedule.

@elasticmachine
Copy link
Copy Markdown

💚 Build Succeeded

History

Copy link
Copy Markdown

@kapral18 kapral18 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for addressing

@jmcarlock jmcarlock requested a review from romulets March 27, 2026 14:18
@jmcarlock
Copy link
Copy Markdown
Contributor Author

Thanks you Karen for the review!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dashboard Relates to a Kibana dashboard bug, enhancement, or modification. documentation Improvements or additions to documentation. Applied to PRs that modify *.md files. enhancement New feature or request Integration:ded Data Exfiltration Detection Integration:dga Domain Generation Algorithm Detection Integration:hta Host Traffic Anomalies Integration:lmd Lateral Movement Detection Integration:pad Privileged Access Detection Integration:problemchild Living off the Land Attack Detection Team:Security-Applied ML Elastic Security Protections Machine Learning (ML) team [elastic/sec-applied-ml]

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants