Skip to content

v1.4.10

Latest
Compare
Choose a tag to compare
@flarco flarco released this 12 Jun 10:26

Sling v1.4.10 (2025-06-12T10:42:03Z)

  • Upgrade to AWS SDK for Go v2: The AWS SDK has been upgraded to v2, which brings in a more modern, modular architecture. This required substantial code updates, including adding context to all AWS API calls for better cancellation and timeout control, and improving error handling.

  • New Connector and Format Support:

    • Apache Iceberg: Initial support for the Apache Iceberg table format has been added, using the iceberg-go library. This allows Sling to interact with Iceberg tables for data replication tasks.
    • DuckLake: Support for DuckLake has been introduced as a new database type, extending the capabilities of DuckDB.
    • Google Drive: The tool now supports Google Drive as a file system source.
    • Apache Arrow: Support for the Apache Arrow file format has been implemented, including reader/writer channels and integration into the HTTP import functionality.
  • Enhancements to Existing Connectors:

    • Amazon Athena: Support has been significantly improved with better handling of data and staging locations, standardized SQL keywords, and a PURGE option when dropping tables.
    • PostgreSQL: It's now possible to specify a role in the PostgreSQL connection URL for more granular access control.
    • MySQL/MariaDB: Support for BIT column transformations has been added.
    • DuckDB: The embedded DuckDB version has been updated from 1.1.3 to 1.3.0.
  • General Improvements and Fixes:

    • Timeout handling via SLING_TIMEOUT has been added to replication and pipeline runs.
    • A new TableExists method has been added to the connection interface to check for table existence before performing operations.
    • Several bug fixes were made, including improvements to error messages, handling of dbt parameters for Athena, and fixing unnecessary semicolons in generated DuckDB SQL.