Skip to content

fix: correct GLiNER model name and skip health check#24

Merged
lipikaramaswamy merged 1 commit into
mainfrom
andreatgretel/bugfix/gliner-model-config
Mar 6, 2026
Merged

fix: correct GLiNER model name and skip health check#24
lipikaramaswamy merged 1 commit into
mainfrom
andreatgretel/bugfix/gliner-model-config

Conversation

@andreatgretel
Copy link
Copy Markdown
Collaborator

@andreatgretel andreatgretel commented Mar 6, 2026

Summary

  • Rename nvidia/nemotron-pii to nvidia/gliner-pii (correct model name on build.nvidia.com)
  • Add skip_health_check: true — GLiNER's health check fails because DD sends standard chat params (temperature, top_p) that GLiNER rejects
  • Remove temperature/top_p/max_tokens from GLiNER inference parameters — these are unsupported by the GLiNER API and cause 422 errors

Test plan

  • Verified nvidia/gliner-pii responds correctly on integrate.api.nvidia.com
  • Full pipeline (detection + replacement) runs end-to-end with default nvidia provider

- Rename nvidia/nemotron-pii to nvidia/gliner-pii (correct hosted model name)
- Add skip_health_check: true (GLiNER health check fails because DD sends
  unsupported chat params like temperature/top_p)
- Remove temperature/top_p/max_tokens from inference_parameters (GLiNER
  rejects standard chat completion params)
@andreatgretel andreatgretel requested a review from a team as a code owner March 6, 2026 16:33
Copy link
Copy Markdown
Collaborator

@lipikaramaswamy lipikaramaswamy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. To document, we're skipping health checks because data designer automatically passes params like temperature, etc. which are rejected by this model, despite the model config not listing these params.

@lipikaramaswamy lipikaramaswamy merged commit c35e4cf into main Mar 6, 2026
5 checks passed
@lipikaramaswamy lipikaramaswamy deleted the andreatgretel/bugfix/gliner-model-config branch March 6, 2026 16:58
@andreatgretel andreatgretel changed the title fix: correct GLiNER model name and skip health check fix: correct GLiNER model name and remove unsupported params Mar 6, 2026
@andreatgretel andreatgretel changed the title fix: correct GLiNER model name and remove unsupported params fix: correct GLiNER model name and skip health check Mar 6, 2026
andreatgretel added a commit that referenced this pull request Mar 6, 2026
The health check was failing because temperature/top_p/max_tokens were
being sent to GLiNER, which rejects them. Now that those params have
been removed (#24), the health check passes and skip_health_check is
no longer needed.
andreatgretel added a commit that referenced this pull request Mar 6, 2026
…EADME

- Remove skip_health_check: true from GLiNER config — health check passes
  now that unsupported params were removed in #24
- Fix README: NVIDIA_API_KEY (not NIM_API_KEY) is the correct env var
lipikaramaswamy added a commit that referenced this pull request Mar 6, 2026
* chore: remove unnecessary skip_health_check, fix API key env var in README

- Remove skip_health_check: true from GLiNER config — health check passes
  now that unsupported params were removed in #24
- Fix README: NVIDIA_API_KEY (not NIM_API_KEY) is the correct env var

* fix: update readme code snippets to match api, missed previously

* Update README.md

---------

Co-authored-by: lipikaramaswamy <31832945+lipikaramaswamy@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants