Skip to content

gzip option of sql_to_gcs operator don't compress the data file #9139

@nullhack

Description

@nullhack

Apache Airflow version: 1.10.9

What happened:

When using sql_to_gcs with the option gzip=True, the output data file in gcs is not compressed (and instead the schema file is compressed)

What you expected to happen:

When the option gzip=True, I would expect the data file to be compressed using gzip and no changes to the schema file

How to reproduce it:

Just use sql_to_gcs operator in any project, defining gzip=True.

Expected result:
The output data file will not be compressed but the schema file will be compressed.

Metadata

Metadata

Assignees

No one assigned

    Labels

    kind:bugThis is a clearly a bug

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions