Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

clickhouse-obfuscator: allow to save and load models. #39534

Closed
alexey-milovidov opened this issue Jul 24, 2022 · 0 comments · Fixed by #39541
Closed

clickhouse-obfuscator: allow to save and load models. #39534

alexey-milovidov opened this issue Jul 24, 2022 · 0 comments · Fixed by #39541
Assignees
Labels

Comments

@alexey-milovidov
Copy link
Member

alexey-milovidov commented Jul 24, 2022

Use case

Generate models once and reuse them.

Describe the solution you'd like

Add command line options:

--save file - write serialized models on disk after training and before generating the data; the user can set --limit to 0 to only train the models and save them without proceeding to data generation;
--load file - instead of training the models, load the prepared models from the file and start generating the data.

Serialization format: one byte for version (equals to 0), then simple binary serialization of all the models; the whole file is compressed with ZSTD level 1 using CompressedWriteBuffer (no need to allow any compression options to choose).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant