install error on win10

[ozmel1]

Hi,

Wonderful solution for llms fine-tuning!

I am trying to run quick start example at

https://xturing.stochastic.ai/quickstart

on Windows 10 and getting error with the command
pip install xturing --upgrade

'LINK : fatal error LNK1181: cannot open input file 'aio.lib'
(I did install libaio prior to running this)
Please see full output below

I also tried running it on Kaggle with GPU enabled. The issue over there is out of memory at base model step

"
from xturing.models import BaseModel
model = BaseModel.create("llama_lora")
"

Appreciate any help/advice!

error: subprocess-exited-with-error

python setup.py egg_info did not run successfully.
exit code: 1

[16 lines of output]
test.c
LINK : fatal error LNK1181: cannot open input file 'aio.lib'
Traceback (most recent call last):
File "", line 2, in
File "", line 34, in
File "C:\Users\ma.Najmul.Qureshi.MT-LT07771\AppData\Local\Temp\pip-install-our_uu7i\deepspeed_74238615fa124fd7ae08ea8b4fe80af5\setup.py", line 156, in
abort(f"Unable to pre-compile {op_name}")
File "C:\Users\ma.Najmul.Qureshi.MT-LT07771\AppData\Local\Temp\pip-install-our_uu7i\deepspeed_74238615fa124fd7ae08ea8b4fe80af5\setup.py", line 48, in abort
assert False, msg
AssertionError: Unable to pre-compile async_io
[WARNING] Torch did not find cuda available, if cross-compiling or running with cpu only you can ignore this message. Adding compute capability for Pascal, Volta, and Turing (compute capabilities 6.0, 6.1, 6.2)
DS_BUILD_OPS=1
[WARNING] async_io requires the dev libaio .so object and headers but these were not found.
[WARNING] If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
[WARNING] One can disable async_io with DS_BUILD_AIO=0
[ERROR] Unable to pre-compile async_io
[end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

Encountered error while generating package metadata.

See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

[Toan-Do]

Hi @ozmel1 ,

On Window, you should use WSL. Deepspeed does not work on Window machine without WSL.

[ozmel1]

Hi @ozmel1 ,

On Window, you should use WSL. Deepspeed does not work on Window machine without WSL.

Thanks @Toan-Do. Will do!