[AIRFLOW-2825]Fix S3ToHiveTransfer bug due to case

[XD-DENG]

JIRA

• My PR addresses the following Airflow JIRA issues and references them in the PR title. For example, "[AIRFLOW-XXX] My Airflow PR"
  • https://issues.apache.org/jira/browse/AIRFLOW-2825
  • In case you are fixing a typo in the documentation you can prepend your commit with [AIRFLOW-XXX], code changes always need a JIRA issue.

Description

• Here are some details about my PR, including screenshots of any UI changes:

Because upper/lower case was not considered in the file extension check, S3ToHiveTransfer operator may mistakenly think a GZIP file with uppercase ext ".GZ" (or ".gZ", ".Gz") is not a GZIP file and raise exception.

Tests

• My PR adds the following unit tests OR does not need testing for this extremely good reason:

Commits

• My commits all reference JIRA issues in their subject lines, and I have squashed multiple commits if they address the same issue. In addition, my commits follow the guidelines from "How to write a good git commit message":
  1. Subject is separated from body by a blank line
  2. Subject is limited to 50 characters
  3. Subject does not end with a period
  4. Subject uses the imperative mood ("add", not "adding")
  5. Body wraps at 72 characters
  6. Body explains "what" and "why", not "how"

Documentation

• In case of new functionality, my PR adds documentation that describes how to use it.
  • When adding new operators/hooks/sensors, the autoclass documentation generation needs to be added.

Code Quality

• Passes git diff upstream/master -u -- "*.py" | flake8 --diff

[codecov-io]

Codecov Report

Merging #3665 into master will decrease coverage by <.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #3665      +/-   ##
==========================================
- Coverage   77.51%   77.51%   -0.01%     
==========================================
  Files         205      205              
  Lines       15751    15751              
==========================================
- Hits        12210    12209       -1     
- Misses       3541     3542       +1

Impacted Files	Coverage Δ
airflow/operators/s3_to_hive_operator.py	93.96% <ø> (ø)	⬆️
airflow/models.py	88.54% <0%> (-0.05%)	⬇️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update dfa7b26...c7e5446. Read the comment docs.

[feng-tao]

could you add a test?

[XD-DENG]

Hi @feng-tao, thanks for suggesting this.

I have updated the related test. Instead of adding separate testing items, I updated the existing ones.

[Fokko]

LGTM, thanks @XD-DENG