From 9709f6d3ee1f849c3600979f67409acc421a7679 Mon Sep 17 00:00:00 2001 From: fpagny Date: Wed, 19 Feb 2025 11:53:21 +0100 Subject: [PATCH 1/3] Update fixing-common-issues.mdx Add troubleshooting section for tokens consumption not displayed in Cockpit. --- .../troubleshooting/fixing-common-issues.mdx | 18 ++++++++++++++++++ 1 file changed, 18 insertions(+) diff --git a/pages/generative-apis/troubleshooting/fixing-common-issues.mdx b/pages/generative-apis/troubleshooting/fixing-common-issues.mdx index 48348b84e2..b0d36a9cd2 100644 --- a/pages/generative-apis/troubleshooting/fixing-common-issues.mdx +++ b/pages/generative-apis/troubleshooting/fixing-common-issues.mdx @@ -69,6 +69,24 @@ Below are common issues that you may encounter when using Generative APIs, their } ``` +## Tokens consumption is not displayed in Cockpit Metrics + +### Causes +- Cockpit are isolated by `project_id` and only display tokens consumption related to one project. +- Cockpit `Tokens Processed` graphs along time can take up to an hour to update (to provide more accurate average consumptions over time). Note that the overall `Tokens Processed` counter is updated in real time. + +### Solution +- Ensure you are connecting to the right Cockpit for your project. Cockpits are currently isolated by `project_id`, that you can see in their url: `https://{PROJECT_ID}.dashboard.obs.fr-par.scw.cloud/`. This project should correspond to the one used in the URL you used to perform Generative APIs requests, such as `https://api.scaleway.ai/{PROJECT_ID}/v1/chat/completions`. You can list your projects and their ids in your [Organization Dashboard](https://console.scaleway.com/organization/projects). + +#### Example error behaviour +- When displaying the wrong Cockpit for the project: + - Counter for Tokens Processed or API Requests should display a value of 0 + - Graph across time should be empty +- When displaying the right Cockpit for the project, but waiting for average tokens consumption to display: + - Counter for Tokens Processed or API Requests should display a correct value (different from 0) + - Graph across time should be empty +``` + ## Best practices for optimizing model performance ### Input size management From 4548e5f3981b4c29730267cdbc36e1fb4bb198d4 Mon Sep 17 00:00:00 2001 From: Benedikt Rollik Date: Thu, 20 Feb 2025 11:56:41 +0100 Subject: [PATCH 2/3] Apply suggestions from code review --- .../troubleshooting/fixing-common-issues.mdx | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/pages/generative-apis/troubleshooting/fixing-common-issues.mdx b/pages/generative-apis/troubleshooting/fixing-common-issues.mdx index b0d36a9cd2..493b441d7b 100644 --- a/pages/generative-apis/troubleshooting/fixing-common-issues.mdx +++ b/pages/generative-apis/troubleshooting/fixing-common-issues.mdx @@ -72,18 +72,18 @@ Below are common issues that you may encounter when using Generative APIs, their ## Tokens consumption is not displayed in Cockpit Metrics ### Causes -- Cockpit are isolated by `project_id` and only display tokens consumption related to one project. -- Cockpit `Tokens Processed` graphs along time can take up to an hour to update (to provide more accurate average consumptions over time). Note that the overall `Tokens Processed` counter is updated in real time. +- Cockpit is isolated by `project_id` and only displays token consumption related to one Project. +- Cockpit `Tokens Processed` graphs along time can take up to an hour to update (to provide more accurate average consumptions over time). The overall `Tokens Processed` counter is updated in real time. ### Solution -- Ensure you are connecting to the right Cockpit for your project. Cockpits are currently isolated by `project_id`, that you can see in their url: `https://{PROJECT_ID}.dashboard.obs.fr-par.scw.cloud/`. This project should correspond to the one used in the URL you used to perform Generative APIs requests, such as `https://api.scaleway.ai/{PROJECT_ID}/v1/chat/completions`. You can list your projects and their ids in your [Organization Dashboard](https://console.scaleway.com/organization/projects). +- Ensure you are connecting to the Cockpit corresponding to your Project. Cockpits are currently isolated by `project_id`, which you can see in their URL: `https://PROJECT_ID.dashboard.obs.fr-par.scw.cloud/`. This Project should correspond to the one used in the URL you used to perform Generative APIs requests, such as `https://api.scaleway.ai/{PROJECT_ID}/v1/chat/completions`. You can list your projects and their IDs in your [Organization dashboard](https://console.scaleway.com/organization/projects). #### Example error behaviour -- When displaying the wrong Cockpit for the project: - - Counter for Tokens Processed or API Requests should display a value of 0 +- When displaying the wrong Cockpit for the Project: + - Counter for **Tokens Processed** or **API Requests** should display a value of 0 - Graph across time should be empty -- When displaying the right Cockpit for the project, but waiting for average tokens consumption to display: - - Counter for Tokens Processed or API Requests should display a correct value (different from 0) +- When displaying the right Cockpit for the Project, but waiting for average token consumption to display: + - Counter for **Tokens Processed** or **API Requests** should display a correct value (different from 0) - Graph across time should be empty ``` From 81e20a1c747cf229ac7e8045686f646671803a1e Mon Sep 17 00:00:00 2001 From: Benedikt Rollik Date: Fri, 21 Feb 2025 14:40:11 +0100 Subject: [PATCH 3/3] Apply suggestions from code review MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Co-authored-by: Néda <87707325+nerda-codes@users.noreply.github.com> --- .../troubleshooting/fixing-common-issues.mdx | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/pages/generative-apis/troubleshooting/fixing-common-issues.mdx b/pages/generative-apis/troubleshooting/fixing-common-issues.mdx index 493b441d7b..eca438252d 100644 --- a/pages/generative-apis/troubleshooting/fixing-common-issues.mdx +++ b/pages/generative-apis/troubleshooting/fixing-common-issues.mdx @@ -69,7 +69,7 @@ Below are common issues that you may encounter when using Generative APIs, their } ``` -## Tokens consumption is not displayed in Cockpit Metrics +## Tokens consumption is not displayed in Cockpit metrics ### Causes - Cockpit is isolated by `project_id` and only displays token consumption related to one Project. @@ -78,11 +78,11 @@ Below are common issues that you may encounter when using Generative APIs, their ### Solution - Ensure you are connecting to the Cockpit corresponding to your Project. Cockpits are currently isolated by `project_id`, which you can see in their URL: `https://PROJECT_ID.dashboard.obs.fr-par.scw.cloud/`. This Project should correspond to the one used in the URL you used to perform Generative APIs requests, such as `https://api.scaleway.ai/{PROJECT_ID}/v1/chat/completions`. You can list your projects and their IDs in your [Organization dashboard](https://console.scaleway.com/organization/projects). -#### Example error behaviour +#### Example error behavior - When displaying the wrong Cockpit for the Project: - Counter for **Tokens Processed** or **API Requests** should display a value of 0 - Graph across time should be empty -- When displaying the right Cockpit for the Project, but waiting for average token consumption to display: +- When displaying the Cockpit of a specific Project, but waiting for average token consumption to display: - Counter for **Tokens Processed** or **API Requests** should display a correct value (different from 0) - Graph across time should be empty ```