Skip to content

fix: install xgrammar for jetson docker - #4758

Merged
lvhan028 merged 3 commits into
InternLM:mainfrom
CUHKSZzxy:fix/jetson-xgrammar-install
Jul 16, 2026
Merged

fix: install xgrammar for jetson docker#4758
lvhan028 merged 3 commits into
InternLM:mainfrom
CUHKSZzxy:fix/jetson-xgrammar-install

Conversation

@CUHKSZzxy

Copy link
Copy Markdown
Collaborator

Motivation

The Jetson AI Lab package index may lag xgrammar releases, which can prevent the Jetson Docker image from resolving LMDeploy's xgrammar dependency.

Modification

Preinstall xgrammar==0.1.33 without dependencies from PyPI, while continuing to install the LMDeploy wheel and its CUDA/Torch dependencies from the Jetson AI Lab index.

BC-breaking (Optional)

No.

Testing

Not run (per request; Dockerfile-only dependency installation change).

Assistance

Assisted with Codex + GPT-5.6-Sol xHigh, reviewed manually

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adjusts the Jetson Docker build to avoid dependency-resolution failures when the Jetson AI Lab index lags behind PyPI for the xgrammar package, while keeping the LMDeploy wheel installation (and its CUDA/Torch ecosystem) pinned to the Jetson AI Lab index.

Changes:

  • Add a Dockerfile note explaining the split-index installation strategy for xgrammar vs. LMDeploy wheel dependencies.
  • Preinstall xgrammar==0.1.33 from PyPI (without dependencies), then install the LMDeploy wheel from the Jetson AI Lab index.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread docker/Dockerfile.jetson Outdated
Comment thread docker/Dockerfile.jetson Outdated
@lvhan028
lvhan028 merged commit c5bf8ed into InternLM:main Jul 16, 2026
11 of 13 checks passed
@CUHKSZzxy
CUHKSZzxy deleted the fix/jetson-xgrammar-install branch July 16, 2026 12:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants