Releases: dataflint/spark
Releases · dataflint/spark
Version 0.1.7
Apache Iceberg alerts improvements
Add avg file size in read/write
More information when hovering on stage
Version 0.1.6
Apache Iceberg support:
- Better node naming
- Read metrics and reading small files alerts
- Write metrics and overwriting most of table alerts
Write metrics require enabling an iceberg metric reporter, can be done for you by enabling spark.dataflint.iceberg.autoCatalogDiscovery to true, or setting the iceberg metric reporter manually for each catalog, for example:
spark.sql.catalog.[catalog name].metrics-reporter-impl org.apache.spark.dataflint.iceberg.DataflintIcebergMetricsReporter
Version 0.1.5
- Add support for history server with cluster-mode jobs (i.e. with attempt numbet)
- Fix "wasted cores" calculation
- Fix status tab SQL is flickering when there is SQL with sub queriers
Version 0.1.4
Small fix for scala 2.13 support
Version 0.1.3
Main Changes:
- DataFlint SaaS support
- Partition Skew Alert
You can see the full list of changes in the release notes
Version 0.1.2
Main Changes:
- Scala 2.13 support
- "Core Activity Rate" renamed to "Wasted Cores", new alert for high wasted cores
- The ability to disable anonymous telemetries
You can see the full list of changes in the release notes
Version 0.1.1
Version with a new tab - the Resources tab
Changelog can be found here: https://dataflint.gitbook.io/dataflint-for-spark/overview/release-notes#version-0.1.1
Version 0.1.0
First public release of DataFlint!
Changelog can be found here: https://dataflint.gitbook.io/dataflint-for-spark/overview/release-notes#version-0.1.0