Cannot download file from XET hosted repo using CLI

[khulaifi95]

Describe the bug

Hi, currently cannot download file from XET hosted repo using the CLI.
I think I have had this problem for a while. The progress always stucks at 0% when it's downloading a larger file.

I also tried to uninstall the xet package, the download starts but with very limited speed.

I checked what's described here #399 , it is a bit different. I also attached the dig info in the log section.

Reproduction

pip install "huggingface_hub[hf_xet,hf_transfer]"
export HF_HUB_ENABLE_HF_TRANSFER=1
export HF_HUB_DOWNLOAD_TIMEOUT=30
export HF_XET_MAX_CONCURRENT_DOWNLOADS=10

huggingface-cli download common-pile/uspto_filtered --repo-type dataset --local-dir common_pile_uspto_filtered/

Logs

# dig with 2 endpoints mentioned in previous issues

dig cas-server.xethub.hf.co

; <<>> DiG 9.18.30-0ubuntu0.20.04.2-Ubuntu <<>> cas-server.xethub.hf.co
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 27931
;; flags: qr rd ra; QUERY: 1, ANSWER: 8, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 65494
;; QUESTION SECTION:
;cas-server.xethub.hf.co.       IN      A

;; ANSWER SECTION:
cas-server.xethub.hf.co. 60     IN      A       23.23.86.135
cas-server.xethub.hf.co. 60     IN      A       44.223.228.22
cas-server.xethub.hf.co. 60     IN      A       34.231.113.90
cas-server.xethub.hf.co. 60     IN      A       34.201.246.251
cas-server.xethub.hf.co. 60     IN      A       44.219.97.197
cas-server.xethub.hf.co. 60     IN      A       13.216.197.155
cas-server.xethub.hf.co. 60     IN      A       18.235.154.248
cas-server.xethub.hf.co. 60     IN      A       3.233.98.238

;; Query time: 59 msec
;; SERVER: 127.0.0.53#53(127.0.0.53) (UDP)
;; WHEN: Wed Jul 09 05:50:53 UTC 2025
;; MSG SIZE  rcvd: 180



dig cas-server.xethub.hf.co.

; <<>> DiG 9.18.30-0ubuntu0.20.04.2-Ubuntu <<>> cas-server.xethub.hf.co.
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 47377
;; flags: qr rd ra; QUERY: 1, ANSWER: 8, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 65494
;; QUESTION SECTION:
;cas-server.xethub.hf.co.       IN      A

;; ANSWER SECTION:
cas-server.xethub.hf.co. 38     IN      A       3.233.98.238
cas-server.xethub.hf.co. 38     IN      A       18.235.154.248
cas-server.xethub.hf.co. 38     IN      A       13.216.197.155
cas-server.xethub.hf.co. 38     IN      A       44.219.97.197
cas-server.xethub.hf.co. 38     IN      A       34.201.246.251
cas-server.xethub.hf.co. 38     IN      A       34.231.113.90
cas-server.xethub.hf.co. 38     IN      A       44.223.228.22
cas-server.xethub.hf.co. 38     IN      A       23.23.86.135

;; Query time: 0 msec
;; SERVER: 127.0.0.53#53(127.0.0.53) (UDP)
;; WHEN: Wed Jul 09 05:51:15 UTC 2025
;; MSG SIZE  rcvd: 180

System info

- huggingface_hub version: 0.33.2
- Platform: Linux-5.4.0-205-generic-x86_64-with-glibc2.29
- Python version: 3.8.10
- Running in iPython ?: No
- Running in notebook ?: No
- Running in Google Colab ?: No
- Running in Google Colab Enterprise ?: No
- Token path ?: /home/kevin/.cache/huggingface/token
- Has saved token ?: True
- Who am I ?: khulaifi95
- Configured git credential helpers: store
- FastAI: N/A
- Tensorflow: N/A
- Torch: N/A
- Jinja2: 2.10.1
- Graphviz: N/A
- keras: N/A
- Pydot: N/A
- Pillow: 7.0.0
- hf_transfer: 0.1.9
- gradio: N/A
- tensorboard: N/A
- numpy: 1.24.4
- pydantic: N/A
- aiohttp: 3.10.11
- hf_xet: N/A
- ENDPOINT: https://huggingface.co
- HF_HUB_CACHE: /xxx/.cache/huggingface/hub
- HF_ASSETS_CACHE: /xxx/.cache/huggingface/assets
- HF_TOKEN_PATH: /xxx/.cache/huggingface/token
- HF_STORED_TOKENS_PATH: /xxx/.cache/huggingface/stored_tokens
- HF_HUB_OFFLINE: False
- HF_HUB_DISABLE_TELEMETRY: True
- HF_HUB_DISABLE_PROGRESS_BARS: None
- HF_HUB_DISABLE_SYMLINKS_WARNING: False
- HF_HUB_DISABLE_EXPERIMENTAL_WARNING: False
- HF_HUB_DISABLE_IMPLICIT_TOKEN: False
- HF_HUB_ENABLE_HF_TRANSFER: True
- HF_HUB_ETAG_TIMEOUT: 10
- HF_HUB_DOWNLOAD_TIMEOUT: 30

env | grep HF_XET
HF_XET_MAX_CONCURRENT_DOWNLOADS=10

[jsulz]

Hi @khulaifi95, sorry to hear you're running into this. Just a few questions for you.

When you try to download common-pile/uspto_filtered with hf_xet installed/active are you able to get any Xet-backed files from that repo (any of the .json.gz files), or does it hang on a specific file/after a specific number of files?

When the progress bar stops, do you see any network activity at all?

Are you behind a firewall or proxy?

If behind a firewall, the full list of xet domains to allowlist is:

• cas-server.hf.co (looks like this is already good based on your dig output)
• transfer.xethub.hf.co
• cas-bridge.xethub.hf.co

Allowlisting these may help.

In your system info output, I'm noticing that you have hf_transfer installed, but not hf_xet - I'm assuming this was run after uninstalling hf_xet to test downloading without the package involved. When it was installed, what version did you have? If it's less than the most current release (1.1.5), please upgrade with pip install -U hf-xet

Also, a few notes for future reference:

1. To disable the package for testing you can keep it installed and runexport HF_HUB_DISABLE_XET=1 Then unset that environment variable to re-invoke hf_xet for future downloads.
2. hf_xet runs best by itself - no need to use hf_transfer alongside it

[John6666cat]

I encountered a similar situation in Hugging Face's Gradio Zero GPU space, so I am reporting it just in case. I tried to reproduce the issue with the minimum configuration, but I was unable to reproduce it with just hf_hub_download. There must be some prerequisites, but I have not been able to identify them. The details of the situation are unclear.
I am attaching the log with the HF_DEBUG environment variable enabled.

Actual repo (dedicated for Zero GPU)

https://huggingface.co/spaces/John6666/DiffuseCraftDetailfixTest (Only when Detailfix is enabled)

Related code

https://github.com/R3gm/stablepy/blob/main/stablepy/diffusers_vanilla/adetailer.py#L45

Libraries

hf_transfer               0.1.9
hf-xet                    1.1.5
httpcore                  1.0.9
httpx                     0.28.1
huggingface-hub           0.33.2

When HF_HUB_DISABLE_XET == "0"

[DEBUG] >> detailfix inpaint only
Send: curl -X HEAD -H 'Accept: */*' -H 'Accept-Encoding: identity' -H 'Connection: keep-alive' -H 'user-agent: unknown/None; hf_hub/0.33.2; python/3.10.13; torch/2.2.0' https://huggingface.co/Bingsu/adetailer/resolve/main/face_yolov8n.pt
Request 70440b92-03c0-42f3-896f-7696aaeacb1f: HEAD https://huggingface.co/Bingsu/adetailer/resolve/main/face_yolov8n.pt (authenticated: False)
Downloading 'face_yolov8n.pt' to '/home/user/cache/huggingface/hub/models--Bingsu--adetailer/blobs/70b640f8f60b1cf0dcc72f30caf3da9495eb2fb6509da48c53374ad6806e6a9c.incomplete'
Xet Storage is enabled for this repo. Downloading file from Xet Storage..
Send: curl -X GET -H 'Accept: */*' -H 'Accept-Encoding: gzip, deflate' -H 'Connection: keep-alive' -H 'user-agent: unknown/None; hf_hub/0.33.2; python/3.10.13; torch/2.2.0' https://huggingface.co/api/models/Bingsu/adetailer/xet-read-token/53cc19de382014514d9d4038601d261a7faa9b7b
Request d53d9b7a-d435-4bbb-9b09-0503a49ff176: GET https://huggingface.co/api/models/Bingsu/adetailer/xet-read-token/53cc19de382014514d9d4038601d261a7faa9b7b (authenticated: False)

face_yolov8n.pt:   0%|          | 0.00/6.23M [00:00<?, ?B/s]Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/gradio/queueing.py", line 567, in process_events
    response = await route_utils.call_process_api(
  File "/usr/local/lib/python3.10/site-packages/gradio/route_utils.py", line 270, in call_process_api
    output = await app.get_blocks().process_api(
  File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1908, in process_api
    result = await self.call_function(
  File "/usr/local/lib/python3.10/site-packages/gradio/blocks.py", line 1497, in call_function
    prediction = await utils.async_iteration(iterator)
  File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 632, in async_iteration
    return await iterator.__anext__()
  File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 625, in __anext__
    return await anyio.to_thread.run_sync(
  File "/usr/local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2470, in run_sync_in_worker_thread
    return await future
  File "/usr/local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 967, in run
    result = context.run(func, *args)
  File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 608, in run_sync_iterator_async
    return next(iterator)
  File "/usr/local/lib/python3.10/site-packages/gradio/utils.py", line 791, in gen_wrapper
    response = next(iterator)
  File "/home/user/app/app.py", line 682, in sd_gen_generate_pipeline
    yield from dynamic_gpu_duration(
  File "/usr/local/lib/python3.10/site-packages/spaces/zero/wrappers.py", line 353, in gradio_handler
    raise error("ZeroGPU worker error", "GPU task aborted")
gradio.exceptions.Error: 'GPU task aborted'

When HF_HUB_DISABLE_XET == "1" (or huggingface-hub==0.29.3)

[DEBUG] >> detailfix inpaint only
Send: curl -X HEAD -H 'Accept: */*' -H 'Accept-Encoding: identity' -H 'Connection: keep-alive' -H 'user-agent: unknown/None; hf_hub/0.33.2; python/3.10.13; torch/2.2.0' https://huggingface.co/Bingsu/adetailer/resolve/main/face_yolov8n.pt
Request da5c7eeb-cde3-4591-8fb3-1ec56b34cdf8: HEAD https://huggingface.co/Bingsu/adetailer/resolve/main/face_yolov8n.pt (authenticated: False)
Downloading 'face_yolov8n.pt' to '/home/user/cache/huggingface/hub/models--Bingsu--adetailer/blobs/70b640f8f60b1cf0dcc72f30caf3da9495eb2fb6509da48c53374ad6806e6a9c.incomplete'
Xet Storage is enabled for this repo, but the 'hf_xet' package is not installed. Falling back to regular HTTP download. For better performance, install the package with: `pip install huggingface_hub[hf_xet]` or `pip install hf_xet`
Send: curl -X GET -H 'Accept: */*' -H 'Accept-Encoding: gzip, deflate' -H 'Connection: keep-alive' -H 'user-agent: unknown/None; hf_hub/0.33.2; python/3.10.13; torch/2.2.0' https://huggingface.co/Bingsu/adetailer/resolve/main/face_yolov8n.pt
Request fc4a1bcd-edc3-4be7-8a81-5e677d3d066f: GET https://huggingface.co/Bingsu/adetailer/resolve/main/face_yolov8n.pt (authenticated: False)
Send: curl -X GET -H 'Accept: */*' -H 'Accept-Encoding: gzip, deflate' -H 'Connection: keep-alive' -H 'X-Amzn-Trace-Id: fc4a1bcd-edc3-4be7-8a81-5e677d3d066f' -H 'user-agent: unknown/None; hf_hub/0.33.2; python/3.10.13; torch/2.2.0' 'https://cas-bridge-direct.xethub.hf.co/xet-bridge-us/644877453e498d66919f36ec/d1126adb762a2a935e6a9780395360ba6a223144ee012777342d4258180c3e93?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=cas%2F20250715%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20250715T120811Z&X-Amz-Expires=3600&X-Amz-Signature=aa51962afa1a10267fe3cebb4cdc094e25f7b084fc45301118293c44ed5a2aea&X-Amz-SignedHeaders=host&X-Xet-Cas-Uid=public&response-content-disposition=inline%3B%20filename%2A%3DUTF-8%27%27face_yolov8n.pt%3B%20filename%3D%22face_yolov8n.pt%22%3B&x-id=GetObject'
Request fc4a1bcd-edc3-4be7-8a81-5e677d3d066f: GET https://cas-bridge-direct.xethub.hf.co/xet-bridge-us/644877453e498d66919f36ec/d1126adb762a2a935e6a9780395360ba6a223144ee012777342d4258180c3e93?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Content-Sha256=UNSIGNED-PAYLOAD&X-Amz-Credential=cas%2F20250715%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20250715T120811Z&X-Amz-Expires=3600&X-Amz-Signature=aa51962afa1a10267fe3cebb4cdc094e25f7b084fc45301118293c44ed5a2aea&X-Amz-SignedHeaders=host&X-Xet-Cas-Uid=public&response-content-disposition=inline%3B%20filename%2A%3DUTF-8%27%27face_yolov8n.pt%3B%20filename%3D%22face_yolov8n.pt%22%3B&x-id=GetObject (authenticated: False)

face_yolov8n.pt:   0%|          | 0.00/6.23M [00:00<?, ?B/s]
face_yolov8n.pt: 100%|██████████| 6.23M/6.23M [00:00<00:00, 33.0MB/s]
Download complete. Moving file to /home/user/cache/huggingface/hub/models--Bingsu--adetailer/blobs/70b640f8f60b1cf0dcc72f30caf3da9495eb2fb6509da48c53374ad6806e6a9c
Creating pointer from ../../blobs/70b640f8f60b1cf0dcc72f30caf3da9495eb2fb6509da48c53374ad6806e6a9c to /home/user/cache/huggingface/hub/models--Bingsu--adetailer/snapshots/53cc19de382014514d9d4038601d261a7faa9b7b/face_yolov8n.pt
[INFO] >> No object detected on 1 image with face_yolov8n.pt detector.
[INFO] >> DetailFix: No detections found in image. Returning original image
[INFO] >> Seeds: [775466752]
[INFO] >> ['./images/00001_stable-diffusion-xl-base-1.0_775466752.png']

[jsulz]

@John6666cat judging from the output, this strikes me as a very different issue from the one this issue describes.

At a glance, it's difficult to tell if this is an issue with xet-core/hf-xet or another package, but for now I'm going to pull it off to a separate issue so it can be investigated.

[jsulz]

@khulaifi95 is your issue still ongoing or did any of the information here #407 (comment) help?

[GohioAC]

I am facing a similar issue. I have the following domains whitelisted (https protocol only):

• huggingface.co
• cdn-lfs.huggingface.co
• cdn-lfs-us-1.huggingface.co
• cdn-lfs.hf.co
• cdn-lfs-us-1.hf.co
• cas-bridge.xethub.hf.co
• cas-server.xethub.hf.co
• transfer.xethub.hf.co

I am running huggingface-cli download Qwen/Qwen2.5-Omni-7B --local-dir <path>

The final error is RuntimeError: Data processing error: CAS service error : ReqwestMiddleware Error: Request failed after 5 retries and I'm getting a lot of intermediate errors as below:

{"timestamp":"2025-07-25T13:09:21.112501Z","level":"WARN","fields":{"message":"Reqwest(reqwest::Error { kind: Request, source: hyper_util::client::legacy::Error(Connect, ConnectError(\"tcp connect error\", 52.4.65.
99:443, Os { code: 110, kind: TimedOut, message: \"Connection timed out\" })) }). Retrying..."},"filename":"/home/runner/work/xet-core/xet-core/cas_client/src/http_client.rs","line_number":242}
{"timestamp":"2025-07-25T13:09:21.112508Z","level":"WARN","fields":{"message":"Retry attempt #2. Sleeping 4.323182874s before the next attempt"},"filename":"/root/.cargo/registry/src/index.crates.io-1949cf8c6b5b557
f/reqwest-retry-0.7.0/src/middleware.rs","line_number":171}

What am I missing?

[alphacoder01]

I recently faced a similar issue while downloading google/gemma-3-27b-it
It worked by disabling xet i.e HF_HUB_DISABLE_XET = "1"

I have:
huggingface-hub==0.34.2
hf-xet==1.1.5
httpcore==1.0.9
httpx==0.28.1
no hf_transfer

simply used:
HF_HUB_DISABLE_XET=1 hf download "google/gemma-3-27b-it"

[jsulz]

Hi @GohioAC and @alphacoder01 thank you for the report.

@alphacoder01 when you encounter this, does your download hang without network activity?

Could you both run the same command but with RUST_LOG=debug added to the command before execution? This output can be quite verbose so you can capture it by sending it to a log file and attaching that here; e.g.:

RUST_LOG=debug hf download google/gemma-3-27b-it | tee output.log

Also, any information that either of you have about your platform/operating system would be helpful - thank you!

[GohioAC]

@jsulz, PFA the requested logs: output.log

[jsulz]

Thanks @GohioAC - appreciate it. I'm not seeing any successful connection requests in these logs, which is quite interesting!

Two more questions for you:

1. What output to you get when you run curl -v https://cas-server.xethub.hf.co/reconstruction/9d25e2dba955724afc87a17c96c4d8e271ae90ece3c937bdc0165bd0e55b6cf9?
2. Can you try to disable hf-xet (set the HF_HUB_DISABLE_XET to 1 - export HF_HUB_DISABLE_XET=1) before the download and let me know if that changes the behavior?

[GohioAC]

Hi @jsulz
On digging a bit deeper, I found an error in my proxy setup. Working on fixing it and will let you know if it starts working afterwards. Thank you for being so supportive, and I apologise for the inconvenience.

[jsulz]

@khulaifi95 has this continued to be an issue for you?

If so, please review my comment here #407 (comment) and let me know if any of the steps help (make sure that you have hf-xet installed and active as you do)

[M-Moein-M]

Hi,
My problem with "vllm serve" for serving XET hosted repos got me here.
The thing that worked for me on Linux and might help you:

After installing vllm, I also installed
pip install hf-transfer
pip install -U huggingface_hub
huggingface-cli login # then paste your token
export HF_HUB_DISABLE_XET=1

[jsulz]

Hi @M-Moein-M sorry to hear you encountered an issue! Could you describe your problem in more detail? It would be helpful to know:

• What error/issue you encountered (this thread has a few different reports on it that aren't directly related to one-another)
• What APIs/commands you were using when you encountered the issue
• Any information about your environment (using hf env and copying and pasting the output here would be great)