Join GitHub today
GitHub is home to over 31 million developers working together to host and review code, manage projects, and build software together.Sign up
How to append to parquet file periodically and read intermediate data - pyarrow.lib.ArrowIOError: Invalid parquet file. Corrupt footer. #3203
I'm adding new data to a parquet file every 60 seconds using this code:
This is working fine and the file grows every 60 seconds.
which results in this error:
Is there a way to achieve this?
Ah I didn't subscribe..…
On Tue, 18 Dec 2018, 19:52 Wes McKinney ***@***.*** wrote: I don't think I did either. @dazzag24 <https://github.com/dazzag24> make sure to first subscribe to the mailing list you write to — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#3203 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABAcVzbjgKKRRgBU93vyBycPCn44DxfYks5u6UeRgaJpZM4ZWnmY> .