Skip to content

Feature Request: Add NVIDIA (build.nvidia.com / NIM API) as a provider #2498

Description

@vjunior1981

Feature Request: Add NVIDIA (build.nvidia.com / NIM API) as a provider

Summary

I want CodexBar to track NVIDIA's hosted inference offering. This includes the NVIDIA API Catalog and NIM endpoints at https://integrate.api.nvidia.com/v1, using an nvapi- key from https://build.nvidia.com/settings/api-keys.

Currently, there is no NVIDIA entry in docs/providers.md, no UsageProvider case, and no mention of nvidia in the documentation. This is a new-provider request, not a bug.

Relevance: The catalog provides coding-capable open-weight models like Nemotron, DeepSeek, Qwen, GLM, GPT-OSS, and Llama through an OpenAI-compatible interface. This makes it a suitable backend for coding agents and OpenAI-compatible CLIs. This is the same audience CodexBar serves with providers like GroqCloud, OpenRouter, Doubao, and LLM Proxy.

Investigation findings

I have documented what I found from public sources to help a maintainer evaluate this before coding. I am not suggesting a specific implementation.

The account data surface is thin, which is the main issue here.

  • NVIDIA has ended the API-credit model for the API Catalog. Developer Relations team members have said on the NVIDIA Developer Forums that the credits system is gone, and trial access is now subject to a rate limit that changes based on the model, use case, and current overall traffic.
  • This has been replaced by a per-account request-rate limit shown in the build.nvidia.com account UI (at the top right of the navigation bar). The default baseline for new accounts is about 40 RPM. Increases are granted on a case-by-case basis through forum requests.
  • For CodexBar, there is no monthly, weekly, or session quota on the free tier. I also couldn't find a public endpoint that provides account-level usage, balance, or the current rate-limit ceiling.

Auth conventions:

  • The API key prefix is nvapi-, which is generated at https://build.nvidia.com/settings/api-keys.
  • The standard environment variable is NVIDIA_API_KEY.
  • It should be passed as a standard Authorization: Bearer header, and the endpoint is OpenAI-compatible.
curl -s https://integrate.api.nvidia.com/v1/models \
  -H "Authorization: Bearer $NVIDIA_API_KEY"

Candidate data surfaces (need to check with a live key before making a commitment):

Surface What it might give Status
GET /v1/models on integrate.api.nvidia.com model catalog; confirms key validity unverified
Response headers on POST /v1/chat/completions x-ratelimit-* type remaining/limit counters, if included unverified
429 response body/headers effective limit + retry window unverified
build.nvidia.com account page (cookie auth) per-account rate-limit ceiling displayed in the UI server-rendered, cookie-gated
NGC / DGX Cloud billing APIs (api.ngc.nvidia.com) paid-tier spending, organization/team scoped out of scope for this request, see open questions

I have not tested the authenticated paths yet. If the maintainers find this request reasonable, I can run the probe matrix and share the raw results (with sensitive information redacted) in this thread.

Operator: NVIDIA Corporation, Santa Clara, CA. They operate the endpoints directly and are not a reseller or a relay. This should keep it outside the hosted-relay eligibility rules in docs/provider.md.

Existing CodexBar providers with a similar shape

These are listed as potential reference points, not recommendations:

  • GroqCloud — API key, metrics-style request/token counters (docs/groqcloud.md).
  • Doubao — API key is used for request-limit checks instead of a quota window (docs/doubao.md).
  • DeepSeek — API key, balance-only, no reset window (docs/deepseek.md).
  • Mistral — browser-cookie path scraping a server-rendered dashboard for plan and reset information, which is the closest reference if the build.nvidia.com account page ends up being the only source for the rate-limit ceiling.

Open questions for the maintainer

  1. Since the free tier does not have a quota window, is a rate-limit-oriented v1 acceptable? This would show the effective RPM limit and recent throttling instead of a percentage-used bar. Or does CodexBar want to wait until NVIDIA provides a usage endpoint?
  2. If the limit can only be found on the build.nvidia.com account page, is a Mistral-style browser-cookie strategy suitable for a provider whose API-key path cannot provide the same data?
  3. Should NGC / DGX Cloud paid spending be treated as a separate provider that is more aligned with the AWS Bedrock Cost Explorer integration rather than merging it into this one?
  4. Is a local cost-scan option of interest for agents configured for integrate.api.nvidia.com, using the existing Codex/Claude log-scan architecture, or is this out of scope?

References

Metadata

Metadata

Assignees

No one assigned

    Labels

    P3Low-risk cleanup, docs, polish, ergonomics, or speculative feature.clawsweeper:needs-maintainer-reviewClawSweeper marked this issue as needing maintainer review before automation.clawsweeper:needs-product-decisionClawSweeper marked this issue as needing a product or behavior decision.clawsweeper:no-new-fix-prClawSweeper does not recommend queueing a new automated fix PR for this issue.impact:auth-providerThis issue is about auth, provider routing, model choice, or SecretRef resolution.issue-rating: 🌊 off-meta tidepoolIssue quality rating does not apply to this item.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions