-
Notifications
You must be signed in to change notification settings - Fork 266
Open
Description
Describe the bug
When using the getting started sample from https://github.com/microsoft/Olive#-getting-started I get the warning
Xet Storage is enabled for this repo, but the 'hf_xet' package is not installed. Falling back to regular HTTP download. For better performance, install the package with: pip install huggingface_hub[hf_xet]orpip install hf_xet
It would be useful to have this package installed by default IMO.
I could contribute a PR.
To Reproduce
(venv) C:\work\microsoft\Olive>olive optimize --model_name_or_path Qwen/Qwen2.5-0.5B-Instruct --precision int4 --output_path models/qwen
Loading HuggingFace model from Qwen/Qwen2.5-0.5B-Instruct
config.json: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 659/659 [00:00<?, ?B/s]
C:\work\microsoft\Olive\venv\Lib\site-packages\huggingface_hub\file_download.py:143: UserWarning: `huggingface_hub` cache-system uses symlinks by default to efficiently store duplicated files but your machine does not support them in C:\Users\merklbe1\.cache\huggingface\hub\models--Qwen--Qwen2.5-0.5B-Instruct. Caching files will still work but in a degraded version that might require more space on your disk. This warning can be disabled by setting the `HF_HUB_DISABLE_SYMLINKS_WARNING` environment variable. For more details, see https://huggingface.co/docs/huggingface_hub/how-to-cache#limitations.
To support symlinks on Windows, you either need to activate Developer Mode or to run Python as an administrator. In order to activate developer mode, see this article: https://docs.microsoft.com/en-us/windows/apps/get-started/enable-your-device-for-development
warnings.warn(message)
`torch_dtype` is deprecated! Use `dtype` instead!
`torch_dtype` is deprecated! Use `dtype` instead!
Xet Storage is enabled for this repo, but the 'hf_xet' package is not installed. Falling back to regular HTTP download. For better performance, install the package with: `pip install huggingface_hub[hf_xet]` or `pip install hf_xet`
Expected behavior
I would expect to get no warning or no missing package with the default configuration.
Olive config
Add Olive configurations here.
Olive logs
Add logs here.
Other information
- OS: [e.g. Windows, Linux]
- Olive version: [e.g. 0.4.0 or main]
- ONNXRuntime package and version: [e.g. onnxruntime-gpu: 1.16.1]
- Transformers package version: [e.g. transformers 4.44.1]
Additional context
Add any other context about the problem here.
Metadata
Metadata
Assignees
Labels
No labels