Skip to content

Commit

Permalink
feat(aim): update configs for python and node in python and node conf…
Browse files Browse the repository at this point in the history 
…ig pages
  • Loading branch information
@akristen
akristen committed Mar 7, 2024
1 parent e3b7927 commit 85c738d
Show file tree
Hide file tree
Showing 2 changed files with 426 additions and 0 deletions.
213 changes: 213 additions & 0 deletions ...m/agents/nodejs-agent/installation-configuration/nodejs-agent-configuration.mdx
View file
Expand Up @@ -919,6 +919,219 @@ This section defines the Node.js agent variables in the order they typically app
</Collapser>
</CollapserGroup>

## AI monitoring [#ai-monitoring]

This section includes Node.js agent configurations for setting up AI monitoring.

<Callout variant="important">
You need to set [distributed_tracing](/docs/apm/agents/nodejs-agent/installation-configuration/nodejs-agent-configuration/#dt-main) to `true` to capture trace and feedback data. It is turned on by default in Node.js agents 8.3.0 and higher.
</Callout>

<CollapserGroup>
<Collapser
id="ai-monitoring-enabled"
title="ai_monitoring.enabled"
>
<table>
<tbody>
<tr>
<th>
Type
</th>

<td>
Boolean
</td>
</tr>

<tr>
<th>
Default
</th>

<td>
`false`
</td>
</tr>

<tr>
<th>
[Environ variable](#environment)
</th>

<td>
`NEW_RELIC_AI_MONITORING_ENABLED`
</td>
</tr>
</tbody>
</table>

When set to `true`, enables AI monitoring.
</Collapser>
<Collapser
id="max-samples-stored"
title="span_events.max_samples_stored"
>
<table>
<tbody>
<tr>
<th>
Type
</th>

<td>
Integer
</td>
</tr>

<tr>
<th>
Default
</th>

<td>
`2000`
</td>
</tr>

<tr>
<th>
[Environ variable](#environment)
</th>

<td>
`NEW_RELIC_SPAN_EVENTS_MAX_SAMPLES_STORED`
</td>
</tr>
</tbody>
</table>

The maximum value is `10000`. Setting this to the maximum value ensures the maximum amount of distributed traces are captured. If you lower this amount, it may impact the fidelity of your AI data.

</Collapser>
<Collapser
id="custom-insights-events"
title="custom_insights_events.max_samples_stored"
>
<table>
<tbody>
<tr>
<th>
Type
</th>

<td>
Integer
</td>
</tr>

<tr>
<th>
Default
</th>

<td>
`3600`
</td>
</tr>

<tr>
<th>
[Environ variable](#environment)
</th>

<td>
`NEW_RELIC_CUSTOM_INSIGHTS_EVENTS_MAX_SAMPLES_STORED`
</td>
</tr>
</tbody>
</table>

Setting this to the maximum value guarantees that the agent captures the maximum number of LLM events. The maximum value is `100000`.
</Collapser>
<Collapser
id="ai-monitoring-streaming"
title="ai_monitoring.streaming.enabled"
>
<table>
<tbody>
<tr>
<th>
Type
</th>

<td>
Boolean
</td>
</tr>

<tr>
<th>
Default
</th>

<td>
`true`
</td>
</tr>

<tr>
<th>
[Environ variable](#environment)
</th>

<td>
`NEW_RELIC_AI_MONITORING_STREAMING_ENABLED`
</td>
</tr>
</tbody>
</table>

When set to `false`, disables instrumentation for streamed LLM data. Set to `true` to captured streamed data for LLM events.

</Collapser>
<Collapser
id="ai-monitoring-record-content"
title="ai_monitoring.record_content.enabled"
>
<table>
<tbody>
<tr>
<th>
Type
</th>

<td>
Boolean
</td>
</tr>

<tr>
<th>
Default
</th>

<td>
`true`
</td>
</tr>

<tr>
<th>
[Environ variable](#environment)
</th>

<td>
`NEW_RELIC_AI_MONITORING_RECORD_CONTENT_ENABLED`
</td>
</tr>
</tbody>
</table>

If set to `false`, agent will omit input and output content (like text strings from prompts and responses) captured in LLM events. This is an optional security setting if you don’t want to record sensitive data sent to and received from your LLMs.
</Collapser>
</CollapserGroup>

## Audit logging [#audit_log]

This section defines the Node.js agent variables in the order they typically appear in the `audit_log: {` section of your app's `newrelic.js` configuration file.
Expand Down

0 comments on commit 85c738d

Please sign in to comment.