Feature Request: Add NVIDIA (build.nvidia.com / NIM API) as a provider
Summary
I want CodexBar to track NVIDIA's hosted inference offering. This includes the NVIDIA API Catalog and NIM endpoints at https://integrate.api.nvidia.com/v1, using an nvapi- key from https://build.nvidia.com/settings/api-keys.
Currently, there is no NVIDIA entry in docs/providers.md, no UsageProvider case, and no mention of nvidia in the documentation. This is a new-provider request, not a bug.
Relevance: The catalog provides coding-capable open-weight models like Nemotron, DeepSeek, Qwen, GLM, GPT-OSS, and Llama through an OpenAI-compatible interface. This makes it a suitable backend for coding agents and OpenAI-compatible CLIs. This is the same audience CodexBar serves with providers like GroqCloud, OpenRouter, Doubao, and LLM Proxy.
Investigation findings
I have documented what I found from public sources to help a maintainer evaluate this before coding. I am not suggesting a specific implementation.
The account data surface is thin, which is the main issue here.
- NVIDIA has ended the API-credit model for the API Catalog. Developer Relations team members have said on the NVIDIA Developer Forums that the credits system is gone, and trial access is now subject to a rate limit that changes based on the model, use case, and current overall traffic.
- This has been replaced by a per-account request-rate limit shown in the
build.nvidia.com account UI (at the top right of the navigation bar). The default baseline for new accounts is about 40 RPM. Increases are granted on a case-by-case basis through forum requests.
- For CodexBar, there is no monthly, weekly, or session quota on the free tier. I also couldn't find a public endpoint that provides account-level usage, balance, or the current rate-limit ceiling.
Auth conventions:
- The API key prefix is
nvapi-, which is generated at https://build.nvidia.com/settings/api-keys.
- The standard environment variable is
NVIDIA_API_KEY.
- It should be passed as a standard
Authorization: Bearer header, and the endpoint is OpenAI-compatible.
curl -s https://integrate.api.nvidia.com/v1/models \
-H "Authorization: Bearer $NVIDIA_API_KEY"
Candidate data surfaces (need to check with a live key before making a commitment):
| Surface |
What it might give |
Status |
GET /v1/models on integrate.api.nvidia.com |
model catalog; confirms key validity |
unverified |
Response headers on POST /v1/chat/completions |
x-ratelimit-* type remaining/limit counters, if included |
unverified |
429 response body/headers |
effective limit + retry window |
unverified |
build.nvidia.com account page (cookie auth) |
per-account rate-limit ceiling displayed in the UI |
server-rendered, cookie-gated |
NGC / DGX Cloud billing APIs (api.ngc.nvidia.com) |
paid-tier spending, organization/team scoped |
out of scope for this request, see open questions |
I have not tested the authenticated paths yet. If the maintainers find this request reasonable, I can run the probe matrix and share the raw results (with sensitive information redacted) in this thread.
Operator: NVIDIA Corporation, Santa Clara, CA. They operate the endpoints directly and are not a reseller or a relay. This should keep it outside the hosted-relay eligibility rules in docs/provider.md.
Existing CodexBar providers with a similar shape
These are listed as potential reference points, not recommendations:
- GroqCloud — API key, metrics-style request/token counters (
docs/groqcloud.md).
- Doubao — API key is used for request-limit checks instead of a quota window (
docs/doubao.md).
- DeepSeek — API key, balance-only, no reset window (
docs/deepseek.md).
- Mistral — browser-cookie path scraping a server-rendered dashboard for plan and reset information, which is the closest reference if the
build.nvidia.com account page ends up being the only source for the rate-limit ceiling.
Open questions for the maintainer
- Since the free tier does not have a quota window, is a rate-limit-oriented v1 acceptable? This would show the effective RPM limit and recent throttling instead of a percentage-used bar. Or does CodexBar want to wait until NVIDIA provides a usage endpoint?
- If the limit can only be found on the
build.nvidia.com account page, is a Mistral-style browser-cookie strategy suitable for a provider whose API-key path cannot provide the same data?
- Should NGC / DGX Cloud paid spending be treated as a separate provider that is more aligned with the AWS Bedrock Cost Explorer integration rather than merging it into this one?
- Is a local cost-scan option of interest for agents configured for
integrate.api.nvidia.com, using the existing Codex/Claude log-scan architecture, or is this out of scope?
References
Feature Request: Add NVIDIA (
build.nvidia.com/ NIM API) as a providerSummary
I want CodexBar to track NVIDIA's hosted inference offering. This includes the NVIDIA API Catalog and NIM endpoints at
https://integrate.api.nvidia.com/v1, using annvapi-key from https://build.nvidia.com/settings/api-keys.Currently, there is no NVIDIA entry in
docs/providers.md, noUsageProvidercase, and no mention ofnvidiain the documentation. This is a new-provider request, not a bug.Relevance: The catalog provides coding-capable open-weight models like Nemotron, DeepSeek, Qwen, GLM, GPT-OSS, and Llama through an OpenAI-compatible interface. This makes it a suitable backend for coding agents and OpenAI-compatible CLIs. This is the same audience CodexBar serves with providers like GroqCloud, OpenRouter, Doubao, and LLM Proxy.
Investigation findings
I have documented what I found from public sources to help a maintainer evaluate this before coding. I am not suggesting a specific implementation.
The account data surface is thin, which is the main issue here.
build.nvidia.comaccount UI (at the top right of the navigation bar). The default baseline for new accounts is about 40 RPM. Increases are granted on a case-by-case basis through forum requests.Auth conventions:
nvapi-, which is generated at https://build.nvidia.com/settings/api-keys.NVIDIA_API_KEY.Authorization: Bearerheader, and the endpoint is OpenAI-compatible.curl -s https://integrate.api.nvidia.com/v1/models \ -H "Authorization: Bearer $NVIDIA_API_KEY"Candidate data surfaces (need to check with a live key before making a commitment):
GET /v1/modelsonintegrate.api.nvidia.comPOST /v1/chat/completionsx-ratelimit-*type remaining/limit counters, if included429response body/headersbuild.nvidia.comaccount page (cookie auth)api.ngc.nvidia.com)I have not tested the authenticated paths yet. If the maintainers find this request reasonable, I can run the probe matrix and share the raw results (with sensitive information redacted) in this thread.
Operator: NVIDIA Corporation, Santa Clara, CA. They operate the endpoints directly and are not a reseller or a relay. This should keep it outside the hosted-relay eligibility rules in
docs/provider.md.Existing CodexBar providers with a similar shape
These are listed as potential reference points, not recommendations:
docs/groqcloud.md).docs/doubao.md).docs/deepseek.md).build.nvidia.comaccount page ends up being the only source for the rate-limit ceiling.Open questions for the maintainer
build.nvidia.comaccount page, is a Mistral-style browser-cookie strategy suitable for a provider whose API-key path cannot provide the same data?integrate.api.nvidia.com, using the existing Codex/Claude log-scan architecture, or is this out of scope?References