Skip to content

cherry-pick commits #211

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Sep 26, 2025
Merged

cherry-pick commits #211

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
f94dd06
Bump keras in /models_v2/tensorflow/bert_large/inference/cpu (#2808)
dependabot[bot] Aug 13, 2025
9bbcf7e
Turn on use_small_dequant_buffer flag for llm imference on CPU with I…
Xia-Weiwen Sep 3, 2025
40b047d
replace extra-index-url with index-irl (#2819)
sramakintel Sep 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/general/pytorch/BareMetalSetup.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ Prepare the environment, you may create a Python virtual enviromment `virtualenv
python -m pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu

# Install oneccl:
python -m pip install oneccl_bind_pt --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/cpu/us/
python -m pip install oneccl_bind_pt --index-url https://pytorch-extension.intel.com/release-whl/stable/cpu/us/

## Install generic dependencies
Make sure the following components are installed in your environment :
Expand Down
2 changes: 1 addition & 1 deletion models_v2/pytorch/bert_large/inference/gpu/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@ BERT_WEIGHT=<path_to_BERT_WEIGHT_directory>/squad_large_finetuned_checkpoint
```
5. Install the latest GPU versions of [torch, torchvision and intel_extension_for_pytorch](https://intel.github.io/intel-extension-for-pytorch/index.html#installation):
```
python -m pip install torch==<torch_version> torchvision==<torchvision_version> intel-extension-for-pytorch==<ipex_version> --extra-index-url https://pytorch-extension.intel.com/release-whl-aitools/
python -m pip install torch==<torch_version> torchvision==<torchvision_version> intel-extension-for-pytorch==<ipex_version> --index-url https://pytorch-extension.intel.com/release-whl-aitools/
```
6. Set environment variables for Intel® oneAPI Base Toolkit:
Default installation location `{ONEAPI_ROOT}` is `/opt/intel/oneapi` for root account, `${HOME}/intel/oneapi` for other accounts
Expand Down
2 changes: 1 addition & 1 deletion models_v2/pytorch/bert_large/training/gpu/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -53,7 +53,7 @@ We are using `hdf5/hdf5_4320_shards_varlength` as the our dataset.
```
5. Install the latest GPU versions of [torch, torchvision and intel_extension_for_pytorch](https://intel.github.io/intel-extension-for-pytorch/index.html#installation):
```
python -m pip install torch==<torch_version> torchvision==<torchvision_version> intel-extension-for-pytorch==<ipex_version> --extra-index-url https://pytorch-extension.intel.com/release-whl-aitools/
python -m pip install torch==<torch_version> torchvision==<torchvision_version> intel-extension-for-pytorch==<ipex_version> --index-url https://pytorch-extension.intel.com/release-whl-aitools/
```
6. Setup required environment paramaters

Expand Down
2 changes: 1 addition & 1 deletion models_v2/pytorch/distilbert/inference/gpu/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ the dataset should be like below
```
5. Install the latest GPU versions of [torch, torchvision and intel_extension_for_pytorch](https://intel.github.io/intel-extension-for-pytorch/index.html#installation):
```
python -m pip install torch==<torch_version> torchvision==<torchvvision_version> intel-extension-for-pytorch==<ipex_version> --extra-index-url https://pytorch-extension.intel.com/release-whl-aitools/
python -m pip install torch==<torch_version> torchvision==<torchvvision_version> intel-extension-for-pytorch==<ipex_version> --index-url https://pytorch-extension.intel.com/release-whl-aitools/
```
6. Set environment variables for Intel® oneAPI Base Toolkit:
Default installation location `{ONEAPI_ROOT}` is `/opt/intel/oneapi` for root account, `${HOME}/intel/oneapi` for other accounts
Expand Down
1 change: 1 addition & 0 deletions models_v2/pytorch/llama/inference/cpu/inductor/run_llm_inductor_greedy.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -119,6 +119,7 @@ def trace_handler(prof):
inductor_config.cpp_wrapper = True
inductor_config.max_autotune = True
inductor_config.max_autotune_gemm_backends = "CPP,ATEN"
inductor_config.cpp.use_small_dequant_buffer = True
torch._dynamo.config.allow_unspec_int_on_nn_module = True

if args.dtype in ["fp32","bf16", "fp16"]:
Expand Down
2 changes: 1 addition & 1 deletion models_v2/pytorch/resnet50v1_5/inference/gpu/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ ImageNet is recommended, the download link is https://image-net.org/challenges/L
```
5. Install the latest GPU versions of [torch, torchvision and intel_extension_for_pytorch](https://intel.github.io/intel-extension-for-pytorch/index.html#installation):
```
python -m pip install torch==<torch_version> torchvision==<torchvvision_version> intel-extension-for-pytorch==<ipex_version> --extra-index-url https://pytorch-extension.intel.com/release-whl-aitools/
python -m pip install torch==<torch_version> torchvision==<torchvvision_version> intel-extension-for-pytorch==<ipex_version> --index-url https://pytorch-extension.intel.com/release-whl-aitools/
```
6. Set environment variables for Intel® oneAPI Base Toolkit:
Default installation location `{ONEAPI_ROOT}` is `/opt/intel/oneapi` for root account, `${HOME}/intel/oneapi` for other accounts
Expand Down
2 changes: 1 addition & 1 deletion models_v2/pytorch/resnet50v1_5/training/gpu/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ ImageNet is recommended, the download link is https://image-net.org/challenges/L
```
5. Install the latest GPU versions of [torch, torchvision and intel_extension_for_pytorch](https://intel.github.io/intel-extension-for-pytorch/index.html#installation):
```
python -m pip install torch==<torch_version> torchvision==<torchvvision_version> intel-extension-for-pytorch==<ipex_version> --extra-index-url https://pytorch-extension.intel.com/release-whl-aitools/
python -m pip install torch==<torch_version> torchvision==<torchvvision_version> intel-extension-for-pytorch==<ipex_version> --index-url https://pytorch-extension.intel.com/release-whl-aitools/
```
6. Set environment variables for Intel® oneAPI Base Toolkit:
Default installation location `{ONEAPI_ROOT}` is `/opt/intel/oneapi` for root account, `${HOME}/intel/oneapi` for other accounts
Expand Down
2 changes: 1 addition & 1 deletion models_v2/pytorch/rnnt/inference/gpu/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -80,7 +80,7 @@ Specify the folder which contains the `rnnt_ckpt.pt` model as parameter `WEIGHT_
```
5. Install the latest GPU versions of [torch, torchvision and intel_extension_for_pytorch](https://intel.github.io/intel-extension-for-pytorch/index.html#installation):
```
python -m pip install torch==<torch_version> torchvision==<torchvision_version> intel-extension-for-pytorch==<ipex_version> --extra-index-url https://pytorch-extension.intel.com/release-whl-aitools/
python -m pip install torch==<torch_version> torchvision==<torchvision_version> intel-extension-for-pytorch==<ipex_version> --index-url https://pytorch-extension.intel.com/release-whl-aitools/
```
6. Set environment variables for Intel® oneAPI Base Toolkit:
Default installation location `{ONEAPI_ROOT}` is `/opt/intel/oneapi` for root account, `${HOME}/intel/oneapi` for other accounts
Expand Down
2 changes: 1 addition & 1 deletion models_v2/pytorch/rnnt/training/gpu/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -79,7 +79,7 @@ please specify the folder path which contains datasets/LibriSpeech as parameter
```
5. Install the latest GPU versions of [torch, torchvision and intel_extension_for_pytorch](https://intel.github.io/intel-extension-for-pytorch/index.html#installation):
```
python -m pip install torch==<torch_version> torchvision==<torchvision_version> intel-extension-for-pytorch==<ipex_version> --extra-index-url https://pytorch-extension.intel.com/release-whl-aitools/
python -m pip install torch==<torch_version> torchvision==<torchvision_version> intel-extension-for-pytorch==<ipex_version> --index-url https://pytorch-extension.intel.com/release-whl-aitools/
```
6. Set environment variables for Intel® oneAPI Base Toolkit:
Default installation location `{ONEAPI_ROOT}` is `/opt/intel/oneapi` for root account, `${HOME}/intel/oneapi` for other accounts
Expand Down
2 changes: 1 addition & 1 deletion models_v2/pytorch/ssd-mobilenetv1/inference/gpu/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ Download from [this URL](https://drive.google.com/drive/folders/1pKn-RifvJGWiOx0
```
5. Install the latest GPU versions of [torch, torchvision and intel_extension_for_pytorch](https://intel.github.io/intel-extension-for-pytorch/index.html#installation):
```
python -m pip install torch==<torch_version> torchvision==<torchvvision_version> intel-extension-for-pytorch==<ipex_version> --extra-index-url https://pytorch-extension.intel.com/release-whl-aitools/
python -m pip install torch==<torch_version> torchvision==<torchvvision_version> intel-extension-for-pytorch==<ipex_version> --index-url https://pytorch-extension.intel.com/release-whl-aitools/
```
6. Set environment variables for Intel® oneAPI Base Toolkit:
Default installation location `{ONEAPI_ROOT}` is `/opt/intel/oneapi` for root account, `${HOME}/intel/oneapi` for other accounts
Expand Down
2 changes: 1 addition & 1 deletion models_v2/pytorch/stable_diffusion/inference/gpu/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@ The scripts will download the dataset automatically. It uses nateraw/parti-promp
```
5. Install the latest GPU versions of [torch, torchvision and intel_extension_for_pytorch](https://intel.github.io/intel-extension-for-pytorch/index.html#installation):
```
python -m pip install torch==<torch_version> torchvision==<torchvvision_version> intel-extension-for-pytorch==<ipex_version> --extra-index-url https://pytorch-extension.intel.com/release-whl-aitools/
python -m pip install torch==<torch_version> torchvision==<torchvvision_version> intel-extension-for-pytorch==<ipex_version> --index-url https://pytorch-extension.intel.com/release-whl-aitools/
```
6. Set environment variables for Intel® oneAPI Base Toolkit:
Default installation location `{ONEAPI_ROOT}` is `/opt/intel/oneapi` for root account, `${HOME}/intel/oneapi` for other accounts
Expand Down
2 changes: 1 addition & 1 deletion models_v2/pytorch/torchrec_dlrm/inference/gpu/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ and the folder will be used as the parameter WEIGHT_DIR later
```
5. Install the latest GPU versions of [torch, torchvision and intel_extension_for_pytorch](https://intel.github.io/intel-extension-for-pytorch/index.html#installation):
```
python -m pip install torch==<torch_version> torchvision==<torchvision_version> intel-extension-for-pytorch==<ipex_version> --extra-index-url https://pytorch-extension.intel.com/release-whl-aitools/
python -m pip install torch==<torch_version> torchvision==<torchvision_version> intel-extension-for-pytorch==<ipex_version> --index-url https://pytorch-extension.intel.com/release-whl-aitools/
```
6. Set environment variables for Intel® oneAPI Base Toolkit:
Default installation location `{ONEAPI_ROOT}` is `/opt/intel/oneapi` for root account, `${HOME}/intel/oneapi` for other accounts
Expand Down
26 changes: 13 additions & 13 deletions models_v2/tensorflow/bert_large/inference/cpu/poetry.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

8 changes: 4 additions & 4 deletions notebooks/AI_Reference_Models.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -168,7 +168,7 @@
" if selected_hardware == 'CPU':\n",
" !python -m pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu\n",
" !python -m pip install intel-extension-for-pytorch\n",
" !python -m pip install oneccl_bind_pt --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/cpu/us/\n",
" !python -m pip install oneccl_bind_pt --index-url https://pytorch-extension.intel.com/release-whl/stable/cpu/us/\n",
"\n",
" print(\"PyTorch CPU packages installed.\")\n",
"\n",
Expand All @@ -190,7 +190,7 @@
" if (install_oneapi):\n",
" print(\"Intel® oneAPI Base Toolkit is installed\")\n",
" print(\"Installing PyTorch for GPU...\")\n",
" !pip install torch==2.1.0a0 torchvision==0.16.a0 torchaudio==2.1.0.a0 intel-extension-for-pytorch==2.1.10+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/\n",
" !pip install torch==2.1.0a0 torchvision==0.16.a0 torchaudio==2.1.0.a0 intel-extension-for-pytorch==2.1.10+xpu --index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/\n",
" print(\"IPEX GPU packages installed.\")\n",
"\n",
" if gpu_series == 'Flex':\n",
Expand Down Expand Up @@ -803,7 +803,7 @@
" if selected_hardware == 'CPU':\n",
" !python -m pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu\n",
" !python -m pip install intel-extension-for-pytorch\n",
" !python -m pip install oneccl_bind_pt --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/cpu/us/\n",
" !python -m pip install oneccl_bind_pt --index-url https://pytorch-extension.intel.com/release-whl/stable/cpu/us/\n",
"\n",
" print(\"PyTorch CPU packages installed.\")\n",
"\n",
Expand All @@ -825,7 +825,7 @@
" if (install_oneapi):\n",
" print(\"Intel® oneAPI Base Toolkit is installed\")\n",
" print(\"Installing PyTorch for GPU...\")\n",
" !pip install torch==2.1.0a0 torchvision==0.16.a0 torchaudio==2.1.0.a0 intel-extension-for-pytorch==2.1.10+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/\n",
" !pip install torch==2.1.0a0 torchvision==0.16.a0 torchaudio==2.1.0.a0 intel-extension-for-pytorch==2.1.10+xpu --index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/\n",
" print(\"IPEX GPU packages installed.\")\n",
"\n",
" if gpu_series == 'Flex':\n",
Expand Down
2 changes: 1 addition & 1 deletion tests/cicd/PyTorch/setup.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ else
export NO_PROXY=""
python -m pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu
python -m pip install intel-extension-for-pytorch
python -m pip install oneccl_bind_pt --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/cpu/us/
python -m pip install oneccl_bind_pt --index-url https://pytorch-extension.intel.com/release-whl/stable/cpu/us/
fi

# Check the operating system type
Expand Down
2 changes: 1 addition & 1 deletion tests/cicd/pytorch/pyt_cpu_setup.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ else
export NO_PROXY=“”
python -m pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cpu
python -m pip install intel-extension-for-pytorch
python -m pip install oneccl_bind_pt --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/cpu/us/
python -m pip install oneccl_bind_pt --index-url https://pytorch-extension.intel.com/release-whl/stable/cpu/us/
fi

# Check the operating system type
Expand Down
2 changes: 1 addition & 1 deletion tests/cicd/pytorch/pyt_xpu_setup.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,5 +26,5 @@ else
echo "Installing pytorch"
export no_proxy=“”
export NO_PROXY=“”
python -m pip install torch==${FRAMEWORK_VERSION} torchvision==${TORCHVISION_VERSION} intel-extension-for-pytorch==${FRAMEWORK_EXTENSION_VERSION} --extra-index-url https://pytorch-extension.intel.com/release-whl-aitools/
python -m pip install torch==${FRAMEWORK_VERSION} torchvision==${TORCHVISION_VERSION} intel-extension-for-pytorch==${FRAMEWORK_EXTENSION_VERSION} --index-url https://pytorch-extension.intel.com/release-whl-aitools/
fi