Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Build and publish Neuron docker image #4838

Open
yaronr opened this issue May 15, 2024 · 0 comments
Open

[Feature]: Build and publish Neuron docker image #4838

yaronr opened this issue May 15, 2024 · 0 comments

Comments

@yaronr
Copy link

yaronr commented May 15, 2024

馃殌 The feature, motivation and pitch

It seems like the current docker images don't support Neuron (Inferentia).
It would be very helpful if there was a tested, managed Neuron docker image to use.
While at the same subject, it would be even better if some documentation would be added on running vLlm Neuron using containers.

Alternatives

DJL?

Additional context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant