Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

There is an error installing fengshen package. #430

Open
Hubotcoder opened this issue Oct 19, 2023 · 0 comments
Open

There is an error installing fengshen package. #430

Hubotcoder opened this issue Oct 19, 2023 · 0 comments

Comments

@Hubotcoder
Copy link

Hubotcoder commented Oct 19, 2023

D:\svn\Fengshenbang-LM-main>pip3 install --editable .
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple
Obtaining file:///D:/svn/Fengshenbang-LM-main
  Preparing metadata (setup.py) ... done
Requirement already satisfied: transformers>=4.17.0 in c:\programdata\anaconda3\envs\chatglm\lib\site-packages (from fengshen==0.0.1) (4.30.2)
Collecting datasets>=2.0.0 (from fengshen==0.0.1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/09/7e/fd4d6441a541dba61d0acb3c1fd5df53214c2e9033854e837a99dd9e0793/datasets-2.14.5-py3-none-any.whl (519 kB)
Collecting pytorch_lightning>=1.5.10 (from fengshen==0.0.1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/98/09/9b2eab7833494e7c82f70c9b2f8e907d38231f4535704e3045a8a4960c8e/pytorch_lightning-2.1.0-py3-none-any.whl (774 kB)
Collecting deepspeed>=0.5.10 (from fengshen==0.0.1)
  Using cached https://pypi.tuna.tsinghua.edu.cn/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (1.1 MB)
  Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [13 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "C:\Users\Administrator\AppData\Local\Temp\pip-install-5yt2rnnb\deepspeed_8460634f010c4d6b9616524a6f71d5b0\setup.py", line 182, in <module>
          abort(f"Unable to pre-compile {op_name}")
        File "C:\Users\Administrator\AppData\Local\Temp\pip-install-5yt2rnnb\deepspeed_8460634f010c4d6b9616524a6f71d5b0\setup.py", line 52, in abort
          assert False, msg
      AssertionError: Unable to pre-compile async_io
      DS_BUILD_OPS=1
      �[93m [WARNING] �[0m async_io requires the dev libaio .so object and headers but these were not found.
      �[93m [WARNING] �[0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
      �[93m [WARNING] �[0m One can disable async_io with DS_BUILD_AIO=0
      �[31m [ERROR] �[0m Unable to pre-compile async_io
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

Hi, thank you for your work!
Is there anything I can do to move on?
Before this, I ran conda install cuda-compiler -c nvidia to address the CUDA_HOME does not exist issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant