run infer failed

[xv44586]

I use A100 40G * 8 to run the huggingface hub code and failed.
I try to add device_map='auto' at AutoModelForSeq2SeqLM.from_pretrained,but not support.
how to run this code?

[duzx16]

Could you please provide the error log? I can run the huggingface code on a single A100 GPU.

[xv44586]

first is OOM ,and I try a shorter prompt(问题：冬天中国...) ,it worked,but the result is not right, so I think maybe it's "half", so I delete "half", OOM again.
the result is not right because is the "half" or I need use the Chinese version?

[duzx16]

first is OOM ,and I try a shorter prompt(问题：冬天中国...) ,it worked,but the result is not right, so I think maybe it's "half", so I delete "half", OOM again. the result is not right because is the "half" or I need use the Chinese version?

Because GLM-10B is the English model. We will upload GLM-10B-Chinese in the future.

[duzx16]

We uploaded GLM-10B-Chinese and GLM-Large-Chinese in the huggingface hub.