-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SUPPORT]FLINK CDC WRITE HUDI, restart job get exception:org.apache.hudi.org.apache.avro.InvalidAvroMagicException: Not an Avro data file #4249
Comments
I also encountered this problem. Is this a bug. What version of Hudi is this? I encountered this problem in 0.9 |
Can you try 0.10.0 please ? Seems has been fixed in the latest version. |
Is the release version 0.10 okay? I see there is also an exception of the 0.10 rc version here #4204 |
Then it is not fixed yet. Would fire a fix then ~ |
Fired a fix in #4296 |
'hoodie.fail.on.timeline.archiving': 'false' |
No, archiving and rollback is different action. |
cc @nsivabalan can you please look into this? |
@wjcwin : Can you post the contents of .hoodie/. Is the rollback.requested meta file of interest is an empty file. I am trying to get a sense of why would an empty rollback.requested file will be created. Will look into the code and update here. Or if you know why this could occur, let me know. |
@nsivabalan ; |
@danny0405 ; nice |
FLINK CDC WRITE HUDI, restart job get exception:org.apache.hudi.org.apache.avro.InvalidAvroMagicException: Not an Avro data file
logs:
it seems like some 0 byte files caused , i try delete this files, become normal , but next time i cancel , submit job , this problem appear again
can you help me . thks
The text was updated successfully, but these errors were encountered: