Skip to content

Pista 2.5.0

Latest
Latest

Choose a tag to compare

View all tags
@jiangxt2 jiangxt2 released this 09 Oct 15:59
Immutable release. Only release title and notes can be modified.
v2.5.0
fe71d40
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Pista 2.5.0

Pista 2.5.0 is the first stable GitHub distribution of the JVM and Spark SQL runtime for recoverable delivery to OLAP engines.

Included capabilities

  • Single-file SQL submission, templates and typed parameters; extensible Processors, Readers and Writers; Spark-native output and metrics.
  • A Catalyst catalog of 30 scalar, aggregate and table functions for network addresses, dates, URLs, JSON, Roaring64 bitmaps and vectors.
  • ClickHouse and Doris batch delivery and local Hadoop Catalog Iceberg SQL integration within the documented, tested support scope.
  • Doris overwrite uses the atomic connector path and fails explicitly when required metadata coordination is unavailable.

Runtime and support scope

Use JDK 17, Scala 2.12.18 and Apache Spark 3.5.8. Verified adapter baselines are ClickHouse 25.3.2.39 and Doris 3.0.6.2; PostgreSQL metadata uses 16.14. See the support matrix and stability policy.

Structured Streaming, Kyuubi submission and unverified Iceberg REST/storage combinations remain Experimental. Delivery and recovery guarantees remain target-scoped.

Distribution and verification

Download pista-2.5.0.jar, the complete Spark-submit runtime. The release also includes pista-2.5.0-src.tar.gz, pista-jvm.cdx.json, release-manifest.json and SHA256SUMS. The manifest records the source commit, runtime baseline and asset hashes; checksums use portable filenames.

Maven Central and PyPI artifacts are outside this release. Follow the release verification instructions.

Doris metadata migration

Existing PostgreSQL metadata stores must apply sqls/postgre/migrations/doris_task_metadata_text.sql before storing long selectors or predicates. The migration preserves task rows and coordination objects. Do not rerun initialization scripts against an existing store. Metadata failure after target publication requires reconciliation before retrying. See configuration and migration guidance.

License

Apache License 2.0. Source and runtime artifacts retain the project LICENSE, NOTICE and third-party attribution.

Assets 8
Loading