Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unable to install apex #52

Open
wgx8130 opened this issue Jun 16, 2023 · 2 comments
Open

unable to install apex #52

wgx8130 opened this issue Jun 16, 2023 · 2 comments

Comments

@wgx8130
Copy link

wgx8130 commented Jun 16, 2023

Does the apex in the INSTALL.md have any function?

I have tried many different methods to install the content of "pip install -v --disable-pip-version-check --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" ./", but they are all not working.

The error is "no module named 'packaging'" error: subprocess-exited-with-error

Without this apex, it seems to be also able to fine-tune the model. Could anyone help me explain the function of apex, or help me install it?

Thanks very very much for any help!

@akhilkedia
Copy link

This issue with apex has been reported here NVIDIA/apex#1679

huggingface/transformers#24351 suggests pinning apex to a specific commit, cd apex && git checkout 82ee367f3da74b4cd62a1fb47aa9806f0f47b58b, after which I can successfully install apex.

However, the current version of apex is incompatible with the version of torch used here, and I get this error NVIDIA/apex#1532.

I am currently trying version 22.04-dev (cd apex && git checkout 22.04-dev) of apex as mentioned in the previous link. With this, apex compiles successfully and python ./main_finetune.py -h also runs successfully, but I cannot say if this version of apex will result in issues down the line.

If the authors can tell us the exact HEAD commit of apex version that they used, we can use that version!

akhilkedia added a commit to akhilkedia/ConvNeXt-V2 that referenced this issue Jun 20, 2023
The latest version of apex currently does not install, as mentioned here facebookresearch#52.

This issue with apex has also been reported here NVIDIA/apex#1679

huggingface/transformers#24351 suggests pinning apex to a specific commit, `cd apex && git checkout 82ee367f3da74b4cd62a1fb47aa9806f0f47b58b`, after which apex installs successfully.

However, that version of apex is incompatible with the version of torch used here, and I get this error NVIDIA/apex#1532.

The previous link suggest using version `22.04-dev` (`cd apex && git checkout 22.04-dev`) of apex. With this, apex compiles successfully and `python ./main_finetune.py` also runs training using amp successfully.

If the authors can tell us the exact HEAD commit of apex version that they used, we can use that version instead!
@wawaa
Copy link

wawaa commented Jul 4, 2023

You don't need to install Apex if you not use amp.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants