We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
mode
Spark has the mode setting to describe readers behavior in case of parsing error.
Reflect PERMISSIVE and FAILFAST settings in case of parsing errors.
PERMISSIVE
FAILFAST
The text was updated successfully, but these errors were encountered:
columnNameOfCorruptRecord
No branches or pull requests
Background
Spark has the
mode
setting to describe readers behavior in case of parsing error.Feature
Reflect
PERMISSIVE
andFAILFAST
settings in case of parsing errors.FAILFAST
- in case of parsing error, the process immediately fails with exceptionPERMISSIVE
- the parsing continues with best effort resultsThe text was updated successfully, but these errors were encountered: