New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Revert "Wrapper the input and oupput stream from HadoopExtendedFileSy… #17435
Conversation
This resolves some errors we are seeing in our tests such as: Failure for format PARQUET with properties {} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The important part of the stack is here, seems to be truncated in the comment.
Caused by: java.lang.UnsupportedOperationException: Byte-buffer read unsupported by input stream
at org.apache.hadoop.fs.FSDataInputStream.read(FSDataInputStream.java:146)
at org.apache.hadoop.fs.FSDataInputStream.read(FSDataInputStream.java:143)
at org.apache.parquet.hadoop.util.H2SeekableInputStream$H2Reader.read(H2SeekableInputStream.java:81)
at org.apache.parquet.hadoop.util.H2SeekableInputStream.readFully(H2SeekableInputStream.java:90)
at org.apache.parquet.hadoop.util.H2SeekableInputStream.readFully(H2SeekableInputStream.java:75)
at org.apache.parquet.hadoop.ParquetFileReader.readFooter(ParquetFileReader.java:542)
```
return fs.create(f, permission, | ||
overwrite, bufferSize, replication, blockSize, progress); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
put into the same line
return fs.create(f, permission, | ||
flags, bufferSize, replication, blockSize, progress, checksumOpt); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
put into the same line
…stem" This reverts commit 195ce18.
0da9254
to
7166752
Compare
…stem"
This reverts commit 195ce18.