Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: support Ascend 910B in the future #6066

Open
jkl375 opened this issue Jul 2, 2024 · 2 comments
Open

[Feature]: support Ascend 910B in the future #6066

jkl375 opened this issue Jul 2, 2024 · 2 comments

Comments

@jkl375
Copy link

jkl375 commented Jul 2, 2024

🚀 The feature, motivation and pitch

Do you have plans to support Ascend 910B in the future?

Alternatives

No response

Additional context

No response

@mgoin
Copy link
Sponsor Collaborator

mgoin commented Jul 2, 2024

Hi @jkl375 we very much accept contributions for new hardware targets! Could you share any resources in terms of Ascend's support for PyTorch to make it easier to scope for vLLM?

@jkl375
Copy link
Author

jkl375 commented Jul 4, 2024

OK, Do you have any hardware resources for Ascend 910b? https://www.hiascend.com/developer/ascendhub/detail/bcf86497fd874004b3b0a6e5d533081e
this is the docker image for ascend llm models, witch have torch_npu.
https://gitee.com/ascend/pytorch This repo is ascend Extension for PyTorch.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants