Skip to content

Releases: digi-deity/polars-hdfs

v0.1.2

Choose a tag to compare

@digi-deity digi-deity released this 26 Oct 21:30

HDFS paths are now handled literally, so Hive partition directories (year=2025/) and file names containing % work, including directory and glob sources.

Requests to the local reader are authenticated with a per-reader random secret, and the reader listens on loopback only.

polars_hdfs.credentials() exposes a reader's endpoint, key pair and s3:// URI, so tools that can read S3 but not HDFS can open the same data.

No temporary configuration files are written any more; this needs hdfs-s3-gateway 0.3.4 or newer.

v0.1.1

Choose a tag to compare

@digi-deity digi-deity released this 25 Oct 20:33

License and metadata release. polars-hdfs is now MIT licensed, and the PyPI page links back to this repository (homepage, source, issues, changelog). No code changes since 0.1.0; CI now also covers Python 3.15.

v0.1.0

Choose a tag to compare

@digi-deity digi-deity released this 25 Oct 14:49

Read HDFS paths with polars: importing polars_hdfs patches polars' read/scan functions so hdfs:// sources are served through a local hdfs-s3-gateway. Requires polars 1.38.1 or newer.