Skip to content

fix(vllm): handle null request metadata - #2139

Merged
bxyu-nvidia merged 1 commit into
mainfrom
amahishi/handle-null-vllm-metadata-signed
Jul 24, 2026
Merged

fix(vllm): handle null request metadata#2139
bxyu-nvidia merged 1 commit into
mainfrom
amahishi/handle-null-vllm-metadata-signed

Conversation

@macandro96

@macandro96 macandro96 commented Jul 24, 2026

Copy link
Copy Markdown
Contributor

Treat explicit metadata=null the same as omitted metadata when processing per-request chat-template and extra-body overrides.

Add regression coverage for Responses API requests containing null metadata.

Signed-off-by: Anish Mahishi <amahishi@nvidia.com>
@copy-pr-bot

copy-pr-bot Bot commented Jul 24, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@bxyu-nvidia
bxyu-nvidia merged commit 473f446 into main Jul 24, 2026
11 checks passed
@bxyu-nvidia
bxyu-nvidia deleted the amahishi/handle-null-vllm-metadata-signed branch July 24, 2026 22:38
tdene added a commit that referenced this pull request Jul 30, 2026
Follow-up to #2139 and #1180

Signed-off-by: Teodor-Dumitru Ene <teodord.ene@gmail.com>
OlegSudakov pushed a commit to OlegSudakov/Gym that referenced this pull request Aug 7, 2026
Treat explicit metadata=null the same as omitted metadata when
processing per-request chat-template and extra-body overrides.

Add regression coverage for Responses API requests containing null
metadata.

Signed-off-by: Anish Mahishi <amahishi@nvidia.com>
OlegSudakov pushed a commit to OlegSudakov/Gym that referenced this pull request Aug 7, 2026
Follow-up to NVIDIA-NeMo#2139 and NVIDIA-NeMo#1180

Signed-off-by: Teodor-Dumitru Ene <teodord.ene@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants