You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
On a new MTL machine, the first time for import torch and import intel_extension_for_pytorch took long time:
# first time on this machine, first time in this conda env
torch import: 21.3665828704834 s
ipex import: 30.279845714569092 s
And the 2nd+ importing time will be significantly reduced in the same conda env
# 2nd+ time on this machine, 2nd+ time in this conda env
torch import: 1.3328015804290771 s
ipex import: 1.3857955932617188 s
When I created another conda env on the same machine with exactly the same python version, torch, ipex version, etc., the first import time will still be long (but not so long as the first time on this machine)
# 2nd+ time on this machine, first time in this conda env
torch import: 14.61411190032959 s
ipex import: 21.118491411209106 s
My question
My question is regarding the long duration it takes to import torch & ipex for the first time. What made this happen? Is there any compilation process involved? How can we reduce the initial import time? The answer would be helpful in a real deployment environment. Thank you!
The text was updated successfully, but these errors were encountered:
Oscilloscope98
changed the title
initial import time of torch & intel_extension_for_pytorch is long on Windows Ultra Core
initial import time of torch & intel_extension_for_pytorch is long on Windows Core Ultra
Apr 17, 2024
Describe the issue
Platform: Intel Core Ultra 7 155H
OS: Windows 11
intel-extension-for-pytorch==2.1.10+xpu
torch==2.1.0a0+cxx11.abi
On a new MTL machine, the first time for
import torch
andimport intel_extension_for_pytorch
took long time:And the 2nd+ importing time will be significantly reduced in the same conda env
When I created another conda env on the same machine with exactly the same python version, torch, ipex version, etc., the first import time will still be long (but not so long as the first time on this machine)
My question
My question is regarding the long duration it takes to import torch & ipex for the first time. What made this happen? Is there any compilation process involved? How can we reduce the initial import time? The answer would be helpful in a real deployment environment. Thank you!
Appendix
Tested conda env
Detailed Env
The text was updated successfully, but these errors were encountered: