Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release version 1.2.0 #75

Merged
merged 21 commits into from
Sep 15, 2020
Merged

Release version 1.2.0 #75

merged 21 commits into from
Sep 15, 2020

Conversation

mmolimar
Copy link
Owner

No description provided.

mmolimar and others added 20 commits July 25, 2020 20:18
* Use header_names instead of column_N if available

* Move header check into buildSchema
and remove hasHeader parameter

* move .forEach to next line
to match the formatting of the previous version of this method

* Become less functional
since ifPresentOrElse is not available in Java 8

* Add test case for custom headers
and header extraction off

* Format method to look similar to before

* Format checkDataWithHeaders to match checkData

* Improve readability of buildSchema

And rearrange so the case of extracted or user provided headers
is handled first and using default headers is handled second

This stems from the potentially incorrect assumption that wanting to use
provided or extracted headers is more common than wanting to use the
default headers

* Apply suggestion to buildSchema
This reduces the verbosity of INFO level logs in FsSourceTask from
files which are being skipped by the policy or are empty. If users still
want to see that they didn't process anything for a file or that they
tried to process an empty file they can drop the level down to DEBUG
and they'll see the log message on line 105
@coveralls
Copy link

coveralls commented Sep 15, 2020

Coverage Status

Coverage increased (+0.4%) to 96.846% when pulling 1655831 on develop into 7ec9293 on master.

@mmolimar mmolimar merged commit 98c5641 into master Sep 15, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants