diff --git a/readme.md b/readme.md index 235a75c9..2d7b7270 100644 --- a/readme.md +++ b/readme.md @@ -37,23 +37,33 @@ IMPORTANT: We have noticed some systems require the VS C++ redistribution, often ### Dev Environment Setup (backend, python) 1. Create and switch the conda environment and go to the service directory. + ```cmd conda create -n aipg_xpu python=3.10 -y -activate aipg_xpu -pip install -r requirements.txt -``` +conda activate aipg_xpu +conda install libuv -y -3. Download the Intel Extension For Pytorch* AOT Packages. Depending on your hardware, download cp310 whl files from the links below. +cd service -Core Ultra-H https://github.com/Nuullll/intel-extension-for-pytorch/releases/tag/v2.1.20%2Bmtl%2Boneapi +@REM for Desktop-dGPU (e.g. A770) +pip install -r requriements-arc.txt -The Arc A - Series dGPU https://github.com/Nuullll/intel-extension-for-pytorch/releases/tag/v2.1.10%2Bxpu +@REM for Intel Core Ultra-H (MTL) +pip install -r requriements-ultra.txt +``` -Install all downloaded whl files using the pip install command +2. Check whether the XPU environment is correct -4. Check whether the XPU environment is correct ```cmd -python -c "import torch; import intel_extension_for_pytorch as ipex; print(torch.version); print(ipex.version); [print(f'[{i}]: {torch.xpu.get_device_properties(i)}') for i in range(torch.xpu.device_count())];" +python -c "import torch; import intel_extension_for_pytorch as ipex; print(torch.__version__); print(ipex.__version__); [print(f'[{i}]: {torch.xpu.get_device_properties(i)}') for i in range(torch.xpu.device_count())];" +``` + +Example output: + +```txt +2.1.0.post3+cxx11.abi +2.1.40+xpu +[0]: _DeviceProperties(name='Intel(R) Arc(TM) Graphics', platform_name='Intel(R) Level-Zero', dev_type='gpu', driver_version='1.3.29283', has_fp64=1, total_memory=14765MB, max_compute_units=112, gpu_eu_count=112) ``` diff --git a/service/requirements-arc.txt b/service/requirements-arc.txt index 7c4d02e8..fe85eee5 100644 --- a/service/requirements-arc.txt +++ b/service/requirements-arc.txt @@ -1,15 +1,14 @@ - - basicsr==1.4.2 compel==2.0.2 datasets==2.18.0 diffusers==0.27.2 Flask==3.0.3 huggingface_hub==0.22.2 -ipex_llm==2.1.0b20240705 -langchain==0.2.2 +ipex_llm==2.1.0 +bigdl-core-xe-21==2.5.0 +bigdl-core-xe-addons-21==2.5.0 +bigdl-core-xe-batch-21==2.5.0 langchain_community==0.2.9 -langchain_core==0.2.4 numpy==1.26.4 opencv_python==4.9.0.80 peft==0.10.0 @@ -19,11 +18,15 @@ Requests==2.32.3 sentence_transformers==2.3.1 transformers==4.39.0 trl==0.9.3 -bigdl-core-xe-21==2.5.0b20240705 -bigdl-core-xe-addons-21==2.5.0b20240705 -bigdl-core-xe-batch-21==2.5.0b20240705 faiss-cpu==1.8.0 docx2txt==0.8 pypdf==4.2.0 unstructured==0.14.6 setuptools==69.5.1 + +--extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/ +torch==2.1.0.post3 +torchvision==0.16.0.post3 +torchaudio==2.1.0.post3 +intel-extension-for-pytorch==2.1.40+xpu +mkl-dpcpp==2024.2.1 diff --git a/service/requirements-ultra.txt b/service/requirements-ultra.txt index 12ff2ed7..2ffb26f9 100644 --- a/service/requirements-ultra.txt +++ b/service/requirements-ultra.txt @@ -1,15 +1,14 @@ - - basicsr==1.4.2 compel==2.0.2 datasets==2.18.0 diffusers==0.27.2 Flask==3.0.3 huggingface_hub==0.22.2 -ipex_llm==2.1.0b20240705 -langchain==0.2.2 +ipex_llm==2.1.0 +bigdl-core-xe-21==2.5.0 +bigdl-core-xe-addons-21==2.5.0 +bigdl-core-xe-batch-21==2.5.0 langchain_community==0.2.9 -langchain_core==0.2.4 numpy==1.26.4 opencv_python==4.9.0.80 peft==0.10.0 @@ -19,11 +18,15 @@ Requests==2.32.3 sentence_transformers==2.3.1 transformers==4.39.0 trl==0.9.3 -bigdl-core-xe-21==2.5.0b20240705 -bigdl-core-xe-addons-21==2.5.0b20240705 -bigdl-core-xe-batch-21==2.5.0b20240705 faiss-cpu==1.8.0 docx2txt==0.8 pypdf==4.2.0 unstructured==0.14.6 -setuptools==69.5.1 \ No newline at end of file +setuptools==69.5.1 + +--extra-index-url https://pytorch-extension.intel.com/release-whl/stable/mtl/us/ +torch==2.1.0.post3 +torchvision==0.16.0.post3 +torchaudio==2.1.0.post3 +intel-extension-for-pytorch==2.1.40+xpu +mkl-dpcpp==2024.2.1