Skip to content

New Agent Builder skills model + usecases & TH agent deprecation#5904

Merged
benironside merged 28 commits into
mainfrom
5719-security-AB-skills
Apr 29, 2026
Merged

New Agent Builder skills model + usecases & TH agent deprecation#5904
benironside merged 28 commits into
mainfrom
5719-security-AB-skills

Conversation

@benironside
Copy link
Copy Markdown
Contributor

@benironside benironside commented Apr 15, 2026

Summary

Fixes #5718, #5719, and #5720.

New pages

  • solutions/security/ai/agent-builder/skills-model.md — "Agents, skills, and tools" conceptual page for Security. Explains the one-agent-many-skills model in 9.4, with a comparison table (Agent / Skill / Tool), an Enable/manage section, the Threat Hunting Agent → skill relationship, and a short FAQ

  • solutions/security/ai/agent-builder/skills-use-cases.md — "Security use cases for Agent Builder." One section per SOC workflow, each naming the built-in skill(s) to enable and 3 example prompts grounded in what the skill actually does (pulled from the Kibana source)

Updated pages

  • solutions/security/ai/agent-builder/agent-builder.md — added an applies-switch so 9.3 keeps the Threat Hunting agent content and 9.4 shows the skills-based content, with links to the two new pages.

  • explore-analyze/ai-features/agent-builder/builtin-agents-reference.md — Threat Hunting Agent section marked deprecated 9.4, with a prominent deprecation warning and a migration-path block pointing to the threat-hunting skill.

  • explore-analyze/ai-features/agent-builder/builtin-skills-reference.md — added two Security skills that were missing:

    • alert-analysis (GA 9.4+)
    • automatic_troubleshooting (preview 9.4, experimental feature flag)

    Also added "Supports ES|QL rule type only" to detection-rule-edit (real constraint from the source).

  • explore-analyze/ai-features/ai-chat-experiences/ai-agent-or-ai-assistant.md — applied your comparison-table updates for 9.4 (via applies-switch so 9.3 preserves the old tables):

  • solutions/toc.yml — adds the two new Security pages as children of agent-builder.md, concepts first then use cases.

Attention @dhru42:

Please double check the following:

  • alert-analysis skill — it's live in the Kibana source but wasn't in the Add Agent Builder skills + dashboards/viz documentation #5868 built-in skills update. Confirm this should ship in 9.4 GA docs and that my description is right.
  • automatic_troubleshooting skill — source registers it behind the automaticTroubleshootingSkill experimental flag. Confirm preview + flag-gated framing is right, or whether it should be held out of docs entirely for 9.4.
  • Example prompts — grounded in Kibana source, but you may have better real-world prompts from demos/POCs.

What's not here

  • Release notes — will be handled separately.
  • Screenshots — need a test env then I'll add some.

Generative AI disclosure

  1. Did you use a generative AI (GenAI) tool to assist in creating this contribution?
  • [ x] Yes Claude 4.6 & 4.7 / Cursor
  • No

@benironside benironside self-assigned this Apr 15, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 15, 2026

Vale Linting Results

Summary: 1 warning, 1 suggestion found

⚠️ Warnings (1)
File Line Rule Message
solutions/security/ai/agent-builder/skills-model.md 29 Elastic.Latinisms Latin terms and abbreviations are a common source of confusion. Use 'using' instead of 'via'.
💡 Suggestions (1)
File Line Rule Message
solutions/security/ai/agent-builder/agent-builder.md 50 Elastic.Clone Use clone only when referring to cloning a GitHub repository or creating a copy that is linked to the original. Often confused with 'copy' and 'duplicate'.

The Vale linter checks documentation changes against the Elastic Docs style guide.

To use Vale locally or report issues, refer to Elastic style guide for Vale.

Comment thread solutions/security/ai/agent-builder/skills-model.md Outdated
Comment thread solutions/security/ai/agent-builder/skills-model.md Outdated
Comment thread solutions/security/ai/agent-builder/skills-model.md Outdated
Comment thread solutions/security/ai/agent-builder/skills-use-cases.md Outdated
@benironside benironside marked this pull request as ready for review April 20, 2026 20:04
@benironside benironside requested review from a team as code owners April 20, 2026 20:04
@dhru42
Copy link
Copy Markdown
Contributor

dhru42 commented Apr 20, 2026

We should show how skills compose together in real SOC workflows. This is one of the most compelling parts of the skills story — it shows that users don't need to context-switch between separate agents. Ex:

Alert-to-Dashboard flow:

User: "What's the context on this critical alert?" → alert-analysis activates
Agent enriches with entity risk, correlates with threat intel
User: "Create a dashboard to track alerts like this going forward" → dashboard-management activates (if the platform skills section is added per item 2)

@benironside
Copy link
Copy Markdown
Contributor Author

We should show how skills compose together in real SOC workflows. This is one of the most compelling parts of the skills story — it shows that users don't need to context-switch between separate agents. Ex:

Alert-to-Dashboard flow:

User: "What's the context on this critical alert?" → alert-analysis activates Agent enriches with entity risk, correlates with threat intel User: "Create a dashboard to track alerts like this going forward" → dashboard-management activates (if the platform skills section is added per item 2)

This is a great example. Happy to add this. Are there any other workflow examples you have in mind?

@dhru42
Copy link
Copy Markdown
Contributor

dhru42 commented Apr 20, 2026

here is the updated feature difference list - we don't need to incude the 3rd column.

image

@dhru42
Copy link
Copy Markdown
Contributor

dhru42 commented Apr 20, 2026

Two items I'd like us to track as immediate follow-ups for the built-in skills reference:

  1. Per-skill tool assignments

The built-in skills reference doesn't show which tools are included in each skill. Users need this to understand what actions the agent can take when a skill is active. For example, does alert-analysis include entity_risk_score_tool? Can threat-hunting call security_labs_search_tool? This mapping should be a simple table in each skill's entry (or a consolidated table on the page). We have draft assignments in ticket #5719 but they need confirmation with engineering before publishing.

  1. Richer skill sections

Each skill currently gets a single definition-list entry (one line). Ticket #5719 requested each skill section include: overview, included tools, prerequisites, invocation methods, limitations, and related resources. The use cases page (skills-use-cases.md) compensates well for example prompts and workflow context, but three things are genuinely missing and can't be found elsewhere in the docs:

  • Prerequisites: alert-analysis requires attack discovery to have been run and the risk score index to exist; automatic_troubleshooting requires the experimental feature flag; security_labs_search tool requires installing Security Labs docs from GenAI Settings
  • Included tools: what tools each skill bundles (see point 1)
  • Limitations: detection-rule-edit supports ES|QL rules only (you did add this one, which is great); automatic_troubleshooting is experimental/flag-gated

Comment thread solutions/security/ai/agent-builder/skills-use-cases.md Outdated
Comment thread solutions/security/ai/agent-builder/skills-use-cases.md Outdated
Comment thread solutions/security/ai/agent-builder/skills-use-cases.md Outdated
@leemthompo
Copy link
Copy Markdown
Member

leemthompo commented Apr 23, 2026

The built-in skills reference doesn't show which tools are included in each skill.

@dhru42 I wonder if the docs are the right place for enumerating the tools associated with a skill, which will evolve quite quickly too over time. I wonder if it isn't better to enable users to check for themselves what tools are associated with a skill via API or UI 🤔

could be a section in https://www.elastic.co/docs/explore-analyze/ai-features/agent-builder/skills

@leemthompo
Copy link
Copy Markdown
Member

Ticket #5719 requested each skill section include: overview, included tools, prerequisites, invocation methods, limitations, and related resources.


**Enable:** `alert-analysis` (optionally combine with [`entity-analytics`](#entity-risk-investigation) for deeper entity context)

Use this workflow to triage a specific alert or work through an alert queue. The agent fetches the alert, finds related alerts that share entities, correlates with {{elastic-sec}} Labs threat intelligence, and recommends a disposition (true positive, benign true positive, false positive, or needs more data). For a multi-skill flow that chains this into a tracking dashboard, refer to [Combining skills across workflows](#combining-skills-across-workflows).
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

workflow might be an overloaded term here?

@dhru42
Copy link
Copy Markdown
Contributor

dhru42 commented Apr 23, 2026

The built-in skills reference doesn't show which tools are included in each skill.

@dhru42 I wonder if the docs are the right place for enumerating the tools associated with a skill, which will evolve quite quickly too over time. I wonder if it isn't better to enable users to check for themselves what tools are associated with a skill via API or UI 🤔

could be a section in https://www.elastic.co/docs/explore-analyze/ai-features/agent-builder/skills

I suggest we do both. If its determined to not be of high value to users (at a later time) we can deprecate it moving forward but we can't assume that its not necessary for folks reading our docs.

@dhru42
Copy link
Copy Markdown
Contributor

dhru42 commented Apr 23, 2026

Ticket #5719 requested each skill section include: overview, included tools, prerequisites, invocation methods, limitations, and related resources.

@leemthompo , I agree we shouldn't repeat the full 3-method explanation per skill -- your core "How skills are invoked" section covers that well. But two Security skills have activation patterns that are genuinely non-obvious and worth a brief per-skill note:

Detection Rule Edit: This skill is attachment-driven. It activates when a rule attachment is present in the conversation. Users need to know the entry points: starting from the rule creation form, from rule details, or by asking "create a detection rule" directly in chat (which creates the attachment for them). Without this, users won't know how to use it.
Alert Analysis: Can be triggered by attaching an alert from the alert flyout, which auto-provides the context the skill needs. Worth a one-liner so users know they can attach an alert rather than manually describing it.

The other four skills (Threat Hunting, Entity Analytics, Security ML Jobs, Endpoint Troubleshooting) follow the standard pattern and can just link back to your core page or just make mention of it at the top of the security docs skills page and link there. So I'd say: skip per-skill invocation sections for most skills, but add a brief "How to activate" note for the two attachment-driven ones.

@approksiu @paulewing let me know if your thoughts as it impacts for your skills.

@erikh-elastic
Copy link
Copy Markdown

@benironside For Entity Analytics Skills. We want to call out that it includes Machine Learning Anomaly Detection jobs specific to security.

Also the following screenshots:
image
image
image

@erikh-elastic
Copy link
Copy Markdown

One more addition from agreement between PMs:

For 9.4, consider the following:
Add a Related Skills section to EA pointing to  find-security-ml-jobs

As calling the EA Skill will also leverage find-security-ml-jobs.

@github-actions
Copy link
Copy Markdown
Contributor

Elastic Docs AI PR menu

Check the box to run an AI review for this pull request.

  • Review docs changes (docs-review). Status: not started.

Powered by GitHub Agentic Workflows and docs-actions. For more information, reach out to the docs team.

Copy link
Copy Markdown
Member

@leemthompo leemthompo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few nits from me, but writing looks great overall 👍

Comment thread explore-analyze/ai-features/agent-builder/builtin-agents-reference.md Outdated
Comment thread explore-analyze/ai-features/agent-builder/builtin-agents-reference.md Outdated
Comment thread explore-analyze/ai-features/agent-builder/builtin-agents-reference.md Outdated
Comment thread explore-analyze/ai-features/agent-builder/builtin-agents-reference.md Outdated
description: Understand how the Elastic AI Agent, Security skills, and tools work together in Elastic Agent Builder for Elastic Security.
---

# Elastic AI Agent, skills, and tools in {{elastic-sec}} [elastic-ai-agent-skills-model]
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

❤️ this page 💅

Comment thread solutions/security/ai/agent-builder/skills-use-cases.md
Copy link
Copy Markdown
Member

@nastasha-solomon nastasha-solomon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great job on this, especially the new pages!

@benironside benironside enabled auto-merge (squash) April 29, 2026 05:00
@benironside benironside merged commit dcba178 into main Apr 29, 2026
12 of 13 checks passed
@benironside benironside deleted the 5719-security-AB-skills branch April 29, 2026 05:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Internal]: [Docs] Deprecation of Threat Hunting Agent (9.4)

6 participants