Releases: juarezr/spark-streaming-google-pubsub
Releases · juarezr/spark-streaming-google-pubsub
Release list
v0.9.4
v0.9.3
v0.9.2
0.9.1
What's Changed
- feat: add code coverage support with JaCoCo and Coveralls by @juarezr in #19
- Introduced new Maven profiles for coverage reporting and Coveralls integration.
- Updated README and documentation to include coverage instructions and usage.
- Enhanced CI workflow to run coverage tests and publish reports to Coveralls when applicable.
- Added integration tests for PubSubClient, validating message publishing and acknowledgment against the Pub/Sub emulator
Full Changelog: v0.9.0...0.9.1
v0.9.0
What's Changed
- feat: implement streaming pull PubSub Subscriber + bounded queue instead of unary Pulls on the driver by @juarezr in #18
- [fix: refine AutoBatchTime logic for adjusting batch interval based on idle micro-batch conditions
- [fix: Connector default batchSize = 64m to reduce pressure while still yielding 38 MiB parquet files
Full Changelog: v0.8.2...v0.9.0
v0.8.2
v0.8.1
v0.8.0
What is Changed
- feat: enhance AutoBatchTime to handle startup noise detection by @juarezr in #14 :
- feat: enhance AutoBatchTime to handle startup noise detection
- refactor[ci]: update release workflow to improve artifact handling
- reorder publishing to release first on GitHub
Full Changelog: v0.7.0...v0.8.0
v0.7.0
What is Changed
Multiple fixes and enhancements by @juarezr in #13
- feat: enhance build information and logging in connector startup
- fix: handle AutoBatchTime with zero trigger mode
- fix: raise processing time from idle start-to-start gaps
- feat: implement debounce logic for idle pulls within a gather batch
- feat: implement Trigger.AvailableNow with drain-until-idle behavior for recovery purposes
- feat: add limitTime parameter to set an exclusive upper bound for message processing based on publish time.
- docs: update README for clarity and add usage examples for Java, Scala, and PySpark
Full Changelog: v0.6.3...v0.7.0