NVIDIA vLLM Blog: Now Serving NVIDIA Nemotron with vLLM #101
Conversation
Signed-off-by: Chris Alexiuk <calexiuk@nvidia.com>
Signed-off-by: Chris Alexiuk <calexiuk@nvidia.com>
chrisalexiuk-nvidia
force-pushed
the
main
branch
from
23096e4 to
d9a25c7
Compare
|
The image seems not rendering. |
|
@codex review |
![chatgpt-codex-connector[bot]](https://avatars.githubusercontent.com/in/1144995?s=60&v=4){kind=small}
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
|  | ||
| > Figure 1: Chart showing accuracy of Nemotron Nano 2 9B on various popular benchmarks | ||
| - **Optimized Thinking:** The model has a new feature called thinking budget which avoids agent overthinking and optimizes for predictable inference cost. The chart below shows that if left alone, models can overthink, increasing inference cost, and in certain cases also reduce accuracy. Thinking budget addresses this challenge by enabling developers to tune the model to achieve the most optimal accuracy-token generation *sweetspot* for their applications. | ||
|
|
||
|  |
There was a problem hiding this comment.
Both image references use ../assets/…. Because posts are rendered at /YYYY/MM/DD/slug.html, those relative paths resolve to /2025/10/assets/... and 404 in production. Other posts use root‑relative URLs (/assets/...) to avoid this. Switch these links to root-relative or {{ '/assets/...'}} so the images render on the published page.
Useful? React with 👍 / 👎.
Signed-off-by: Chris Alexiuk <calexiuk@nvidia.com>
|
@simon-mo - modify image references to match the other examples |
Signed-off-by: Chris Alexiuk <calexiuk@nvidia.com>
Signed-off-by: Chris Alexiuk <calexiuk@nvidia.com>
|
The image resolution is very low, any ways we can swap them? |
|
Hey! We'd like to move ahead with publishing, and I will update the images once we get higher res. versions, if that's alright? |
|
Done. |
2 participants
This PR submits both the content of the blog, as well as two
.pngassets used within the blog.