Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
improvement: run the batch ingestion process in parallel #14
As an improvement:
That would help keep up with the catchup of the database.
Note: I am not asking for parallel table processing when running
well - in principle we got a single mysql instance/process running 3 schema.
As for speed we found that:
So it is not something "special".
The only thing is that I find a lot of things that - to me - looks strange and as we want to have all the data in postgressql we have to make sure that there is no dataloss. Hence all those questions with regards to logging and missmatches...
Besides that I am totally happy with the tool itself - thanks for providing it!
thanks for sharing :)
I'll try to speed up the development of version 2 to provide a better experience :)
@martinsperl-kognitiv I've just pushed an improvement for the replay function. My tests shown a faster execution with the reduction of cpu load and io wait. If you wanna give it a try. :)
The upgrade procedure will add an extra table used by the procedure. Be sure to stop all the replica processes before upgrading the schema and take a backup of sch_chameleon.