Other format converting to arrow

[dentiny]

Hi community, in my daily work, I heavily do a bunch of format conversion (i.e., WARC / ATIF to lance, etc), and I use arrow as an intermediate format.
I notice there's already some crates doing the conversion work in the repo, for example, csv and json, I'm wondering if there's a procedure or place so I could contribute to other format conversions, so we could have a centralized place? Thank you!

Some of my work

• ATIF to arrow: https://github.com/dentiny/atif-arrow
• WARC to arrow: https://github.com/dentiny/warc-rs
• A DuckDB extension to convert all formats I need to handle, all via arrow: https://github.com/dentiny/duckdb_lance_conversion

[Jefffrey]

csv and json are pretty standard and context neutral; atif and warc seem to have specific context usages, so i'm not sure locating such converters into this repo would be a good idea 🤔

i know we have https://github.com/datafusion-contrib/ for Community maintained unofficial extensions for Apache DataFusion and related crates, so perhaps that could be worth considering.