Repository navigation
Releases: digi-deity/polars-hdfs
Release list
v0.1.2
HDFS paths are now handled literally, so Hive partition directories (year=2025/) and file names containing % work, including directory and glob sources.
Requests to the local reader are authenticated with a per-reader random secret, and the reader listens on loopback only.
polars_hdfs.credentials() exposes a reader's endpoint, key pair and s3:// URI, so tools that can read S3 but not HDFS can open the same data.
No temporary configuration files are written any more; this needs hdfs-s3-gateway 0.3.4 or newer.
v0.1.1
License and metadata release. polars-hdfs is now MIT licensed, and the PyPI page links back to this repository (homepage, source, issues, changelog). No code changes since 0.1.0; CI now also covers Python 3.15.
v0.1.0
Read HDFS paths with polars: importing polars_hdfs patches polars' read/scan functions so hdfs:// sources are served through a local hdfs-s3-gateway. Requires polars 1.38.1 or newer.