Skip to content

Commit

Permalink
feat(aim): re-add content that i lost to model comparison page
Browse files Browse the repository at this point in the history
  • Loading branch information
akristen committed Mar 6, 2024
1 parent c9c9e97 commit 66a844a
Show file tree
Hide file tree
Showing 2 changed files with 22 additions and 5 deletions.
1 change: 1 addition & 0 deletions src/content/docs/ai-monitoring/configure-ai-monitoring.mdx
Expand Up @@ -216,3 +216,4 @@ In addition, you may want to adjust these existing configuration options to impr

## Set up user feedback [#user-feedback]

asdf
26 changes: 21 additions & 5 deletions src/content/docs/ai-monitoring/view-ai-data.mdx
Expand Up @@ -163,14 +163,30 @@ To review how to explore your AI data, you can follow the same patterns explain
src={aiAiModelComparisonPage}
/>

The model comparison page lets you compare data between two different models. To populate data:

1. Choose a model in column one.
1. Choose a model in column two.
1. If needed, limit comparison to particular services.
1. Adjust the time picker.
1. Click **See the comparison**.

## What's next? [#whats-next]
The model comparison page gives you the flexibility to analyze performance depending on the use case you're testing for. For example, you can:

Now that you know how to find your data, you can explore other features that AI monitoring has to offer.
* Compare how one model performs within an app against the average performance across all services.
* Compare a specific model and service against another model and service.
* Evaluate how a model performed during a specific time parameter when customer traffic peaked.

* Want to drop sensitive information before it enters into NRDB? [Learn to set up a drop filter](/docs/ai-observability/advanced-customization/drop-sensitive-data)
* If you want forward user feedback information about your app's AI responses to New Relic, [follow our instructions to update your app code to get user feedback in the UI](/docs/ai-observability/advanced-customization/drop-sensitive-data).
* To adjust your data ingest, [explore the AI monitoring configurations](/docs/ai-observability/advanced-customization/adjust-data-ingest) to see if you need to report more or less data.
Keep in mind that this page scopes your model comparison data to a single account. If your organization has multiple accounts that own several AI-powered apps, you wouldn't be able to compare model data between those accounts.

### Understand model cost

### Understand model performance

## What's next? [#whats-next]

Now that you know how to find your data, you can explore other features that AI monitoring has to offer.

* Want to drop sensitive information before it enters into NRDB? [Learn to set up a drop filter](/docs/ai-observability/advanced-customization/drop-sensitive-data).
* If you want forward user feedback information about your app's AI responses to New Relic, [follow our instructions to update your app code to get user feedback in the UI](/docs/ai-observability/advanced-customization/drop-sensitive-data).
* To adjust your data ingest, [explore the AI monitoring configurations](/docs/ai-observability/advanced-customization/adjust-data-ingest) to see if you need to report more or less data.

0 comments on commit 66a844a

Please sign in to comment.