Use the Avro readers from Iceberg-Rust in PyIceberg #1280
Description
Is your feature request related to a problem or challenge?
In PyIceberg, we had challenges with the performance of the Avro readers in the past, therefore, we cythonized quite a bit of the code. Instead, I'm working on using Iceberg-rust instead.
I have a working version for reading the manifests, which is relatively straightforward. For the manifest-list, we dynamically need to load the partition transform, so that will be a bit more challenging, but it is going pretty smooth.
I'll create a draft PR as soon as I get something in a reasonable working state, so I can get feedback from the Rust community. Looking forward seeing my Rust code being butchered 😃
Describe the solution you'd like
No response
Willingness to contribute
None