You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This commit was created on GitHub.com and signed with GitHub’s verified signature.
Release Notes
New Features
Archive Task: Added a new archive pipeline task enabling packing and unpacking of files in ZIP and TAR formats. Supports configurable options for format and action.
Documentation: Included a comprehensive README for usage and configuration of the new archive task.
Improvements
Pipeline Integration: The archive task is now registered in the pipeline task registry, making it available for use in pipeline configurations.
File Task Enhancements: Updated the file task to support context values for file paths, allowing correct handling of file names when dealing with archives.
Performance
Compression Task: Improved SNAPPY compression performance by utilizing a buffered writer.
Testing & Demos
Test Pipelines: Added new test pipelines and sample datasets to demonstrate and validate archive packing and unpacking, covering both single and multi-file scenarios for ZIP and TAR formats.
