Make filesystem destination work with gcs in s3 compatibility mode #1272
Labels
destination
Issue related to new destinations
enhancement
New feature or request
tech-debt
Leftovers from previous sprint that should be fixed over time
GCS has an s3 interoperability mode which emulates s3. This way users could use the s3 bucket filesystem implementation with gcs. This is useful when loading to a final destination which supports connecting to s3 buckets but not gcs, such as clickhouse. Clickhouse now has a custom implementation to handle this, but it would be nice if our filesystem could be set up to use the s3 implementation with gcs buckets, right now based on the bucket url, gcs will always be selected automatically.
If this is done, we can update clickhouse and remove the specialized implementation.
The text was updated successfully, but these errors were encountered: