Skip to content

Update fixing-common-issues.mdx #4446

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Feb 24, 2025
Merged

Update fixing-common-issues.mdx #4446

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
9709f6d
Update fixing-common-issues.mdx
fpagny Feb 19, 2025
4548e5f
Apply suggestions from code review
bene2k1 Feb 20, 2025
81e20a1
Apply suggestions from code review
bene2k1 Feb 21, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
18 changes: 18 additions & 0 deletions pages/generative-apis/troubleshooting/fixing-common-issues.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,6 +69,24 @@ Below are common issues that you may encounter when using Generative APIs, their
}
```

## Tokens consumption is not displayed in Cockpit metrics

### Causes
- Cockpit is isolated by `project_id` and only displays token consumption related to one Project.
- Cockpit `Tokens Processed` graphs along time can take up to an hour to update (to provide more accurate average consumptions over time). The overall `Tokens Processed` counter is updated in real time.

### Solution
- Ensure you are connecting to the Cockpit corresponding to your Project. Cockpits are currently isolated by `project_id`, which you can see in their URL: `https://PROJECT_ID.dashboard.obs.fr-par.scw.cloud/`. This Project should correspond to the one used in the URL you used to perform Generative APIs requests, such as `https://api.scaleway.ai/{PROJECT_ID}/v1/chat/completions`. You can list your projects and their IDs in your [Organization dashboard](https://console.scaleway.com/organization/projects).

#### Example error behavior
- When displaying the wrong Cockpit for the Project:
- Counter for **Tokens Processed** or **API Requests** should display a value of 0
- Graph across time should be empty
- When displaying the Cockpit of a specific Project, but waiting for average token consumption to display:
- Counter for **Tokens Processed** or **API Requests** should display a correct value (different from 0)
- Graph across time should be empty
```

## Best practices for optimizing model performance

### Input size management
Expand Down