ImportError: cannot import name 'mpu' from 'transformers'

[qxpBlog]

@artsobolev @donglixp @intfloat @wolfshow when i run the scriptsbash /home//LMOps-main/minillm/scripts/llama2/sft/sft_7B.sh , this problem happend. My transformers version is 4.38.2. How can i solve it?

[t1101675]

You should use the transformers provided in our repo by pip3 install -e transformers/

[qxpBlog]

You should use the transformers provided in our repo by pip3 install -e transformers/

Thank you for your answer.I have another question:How can I specify the GPU number during code execution when i run the script bash /home//LMOps-main/minillm/scripts/llama2/sft/sft_7B.sh

[t1101675]

This line controls the GPU number.

[qxpBlog]

This line controls the GPU number.

thanks, I have got it.

[Zemtay]

After running "pip3 install -e dpkd/transformers/", I got "RuntimeError: Failed to import transformers.models.auto because of the following error (look up to see its traceback):
cannot import name 'custom_object_save' from 'transformers.dynamic_module_utils'"
How can I fix it?