Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Only Tensors of floating point and complex dtype can require gradients #69

Closed
airzhe opened this issue Jun 25, 2023 · 2 comments
Closed

Comments

@airzhe
Copy link

airzhe commented Jun 25, 2023

openllm start chatglm

......
File "/opt/conda/lib/python3.10/site-packages/accelerate/big_modeling.py", line 108, in register_empty_parameter
module._parameters[name] = param_cls(module._parameters[name].to(device), **kwargs)
File "/opt/conda/lib/python3.10/site-packages/torch/nn/parameter.py", line 36, in new
return torch.Tensor._make_subclass(cls, data, requires_grad)
RuntimeError: Only Tensors of floating point and complex dtype can require gradients

2023-06-25T07:11:30+0000 [ERROR] [runner:llm-chatglm-runner:1] Application startup failed. Exiting.

@aarnphm
Copy link
Member

aarnphm commented Jun 25, 2023

This has been addressed #60. I will wait for #68 to finish and will release a new version. Sorry fro the trouble

@aarnphm
Copy link
Member

aarnphm commented Jun 25, 2023

This has been fixed with 0.1.14

@aarnphm aarnphm closed this as completed Jun 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants