Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Security Solution] [AI Insights] Enable LangSmith tracing in cloud deployments #181159

Merged
merged 1 commit into from
Apr 18, 2024

Commits on Apr 18, 2024

  1. ## [Security Solution] [AI Insights] Enable LangSmith tracing in clou…

    …d deployments
    
    ### Summary
    
    This PR enables LangSmith tracing for the [AI Insights](elastic#180611) feature in cloud deployments.
    
    LangSmith project names and API keys are specified using the same UI and patterns introduced by @spong in <elastic#180227>
    
    ### Details
    
    To enable LangSmith tracing in cloud deployments, configure the following `xpack.securitySolution.enableExperimental` feature flags:
    
    ```
    xpack.securitySolution.enableExperimental: ['assistantModelEvaluation', 'assistantAlertsInsights']
    ```
    
    - The `assistantModelEvaluation` feature flag enables the `Evaluation` settings category in the assistant. The LangSmith project name and API key are configured here
    - The `assistantAlertsInsights` feature flag enables the AI Insights feature, which is off by default at the time of this writing
    
    After enabling the feature flags above:
    
    1) Click the `AI Assistant` button anywhere in the Security Solution to launch the assistant
    
    2) Click the settings gear in the assistant
    
    3) Click the `Evaluation` settings category
    
    4) Click `Show Trace Options (for internal use only)`
    
    5) Specify a `LangSmith Project` and `LangSmith API Key` per the screenshot below:
    
    ![langsmith_settings](https://github.com/elastic/kibana/assets/4459398/896c8155-3a06-4381-becf-b846b5aba426)
    andrew-goldstein committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    f08f960 View commit details
    Browse the repository at this point in the history