-
Notifications
You must be signed in to change notification settings - Fork 100
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[CDAP-15787] Adding failure collector api for format plugins #947
Conversation
35c86c7
to
401aad1
Compare
401aad1
to
acc0a7f
Compare
format-blob/src/main/java/io/cdap/plugin/format/blob/input/BlobInputFormatProvider.java
Outdated
Show resolved
Hide resolved
format-common/src/main/java/io/cdap/plugin/format/plugin/AbstractFileSink.java
Outdated
Show resolved
Hide resolved
format-common/src/main/java/io/cdap/plugin/format/plugin/AbstractFileSink.java
Outdated
Show resolved
Hide resolved
new SimpleDateFormat(suffix); | ||
} | ||
if (!containsMacro("format")) { | ||
if (!containsMacro(NAME_FORMAT)) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this shouldn't have been here before, format is not macro enabled so this will always be true
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
that's weird... it's not annotated as a macro above.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I will remove macros for format property.
Schema schema = config.getSchema(); | ||
FileFormat fileFormat = config.getFormat(); | ||
FileFormat fileFormat = getFileFormat(); | ||
Schema schema = null; | ||
if (fileFormat != null) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this shouldn't have been here either, format is required.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
format is macro enabled tho
format-common/src/main/java/io/cdap/plugin/format/plugin/AbstractFileSource.java
Outdated
Show resolved
Hide resolved
38b8abe
to
c4fce80
Compare
build is green: https://builds.cask.co/browse/HYP-BAD581-22 |
Requires changes from cdapio/cdap#11638 to be merged first
build: https://builds.cask.co/browse/HYP-BAD581-13