Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Converter from standarddump (mysqldump) to myloader readable format #1291

Open
JsBergbau opened this issue Sep 6, 2023 · 3 comments
Open

Comments

@JsBergbau
Copy link

Describe the Feature Request
A converter script would be very helpful to convert a dump created with mysqldump that is readable for myloader.
This brings a big security benefit. Taking the mysqldump some while is no problem, but when there is an error in mydumper you won't be able to restore the database correctly.
However when you have to restore a backup it is important to have this task done fast. There myloader comes into play and rapidly restores the database.
You can run the convert from mysqldump to myloader-format right after each backup and save both. So in case there was something wrong you have the "official" mysqldump backup created with the tools the database engine is shipped with.

Current behaviour
There is no such converter.

Expected behavior
Have a converter. For the benefits, see above.

Environment
mainly linux

Additional context
Add any other context about the problem here.

@davidducos davidducos added this to the Release 0.15.5-1 milestone Oct 23, 2023
@davidducos
Copy link
Member

Hi @JsBergbau,

I have been thinking about it too for a while now...
This is a simple tool that can be written pretty quickly, but we might need to do some changes on myloader.
We are going to use --stream on myloader to make it more flexible, at the end we are going to execute:

cat backup.sql | sql2myloader | myloader --stream <other options>

sql2myloader will add the comment section needed for myloader --stream to parallelize the import.

@JsBergbau
Copy link
Author

cat backup.sql | sql2myloader | myloader --stream <other options>

This sounds even better, because you can convert the standard sql on the fly, no need to prepare like suggested in the first post.

Is there any update on this when this will be available?

@davidducos
Copy link
Member

davidducos commented Jan 12, 2024

Hi @JsBergbau ,
No, there is no ETA.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants