Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automatic Serialization multiples class with metadata #435

Closed
jdedg opened this issue Nov 24, 2023 · 1 comment
Closed

Automatic Serialization multiples class with metadata #435

jdedg opened this issue Nov 24, 2023 · 1 comment

Comments

@jdedg
Copy link

jdedg commented Nov 24, 2023

Issue description

Hi,
It's a long shot, so my client want me to send them parquet files.
We have 75+ types of entities to send them base on messages we get, some have complex array parameters, null and all.
I would love to simply use "await ParquetSerializer.SerializeAsync(dataList, memoryStream);" but my issue is the client want some metadata information using the "writer.CustomMetadata".

I know we are suppose to use the "low-level API" because of the Metadata, but creation one serialiser for each types is a bit much, specialy if we have more types to add in the future.
So I would like to know if there is a way I did not see to have an autogeneration and metadata at the same time.

The reason is I did try to create my autogeneration base on "ParquetSerializer.SerializeAsync" but since "Striper" is not accessible there is a lot of logic to redo just to add metadata.

Thanks

@jdedg jdedg changed the title Serialize multiple class with metadata Automatic Serialization multiples class with metadata Nov 27, 2023
@aloneguid
Copy link
Owner

Sorry for the delay. There isn't anything like that in the public API at the moment, but it should be trivial to add. Serializer uses the same low level api under the bonnet, so you should be able to add some method overload and inject it. Requires a bit of code change though.

@jdedg jdedg closed this as completed Dec 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants