Skip to content

Add Xet support to HTTPFS#3

Merged
adsharma merged 1 commit into
db_configfrom
add-xet-vfs-support
May 18, 2026
Merged

Add Xet support to HTTPFS#3
adsharma merged 1 commit into
db_configfrom
add-xet-vfs-support

Conversation

@adsharma
Copy link
Copy Markdown
Contributor

Summary

  • add a self-contained XetFileSystem for xet:// Hugging Face model, dataset, and space URLs
  • route xet:// paths through HTTPFS without requiring Xet client libraries
  • handle Hugging Face resolve metadata, x-linked-size, signed redirects, and ranged reads
  • add focused Xet URL mapping and glob tests

Validation

  • build/release/extension/httpfs/test/httpfs_xetfs_test --gtest_filter='XetFileSystemTest.*' passed 4/4
  • live validation against ladybugdb/small-kgs: LOAD FROM 'xet://datasets/ladybugdb/small-kgs/main/kg_history/icebug-disk/csr_graph_nodes_person.parquet' RETURN count(*); returned 20

Build note: lbug_httpfs_extension builds successfully. The local build emits existing Homebrew OpenSSL macOS deployment-target linker warnings, but they are warnings only.

@adsharma adsharma merged commit 64084be into db_config May 18, 2026
@adsharma adsharma deleted the add-xet-vfs-support branch May 18, 2026 17:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant