Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

assure product sql does not rise 'packet too large' #8

Closed
daczo opened this issue Mar 18, 2013 · 2 comments
Closed

assure product sql does not rise 'packet too large' #8

daczo opened this issue Mar 18, 2013 · 2 comments
Labels

Comments

@daczo
Copy link
Contributor

daczo commented Mar 18, 2013

'INSERT INTO ... VALUES ...' is a good syntax, yet for large databases its possible that the generated statement will be even larger than 1Gb (mysql maximum possible length of query)

Safeguard is required, maybe by specifying another property
output.maxInsertSize = 16Mb

then inside the code the 'INSERT' statement has to be broken down into several smaller ones, each smaller than 16Mb.
(or throw exception if not possible, for example due to a large CLOB value)

@3awsomies
Copy link
Contributor

We have divided the max insert rows at a time to be max cap as 100. Please check the latest code committed.

@ari
Copy link
Collaborator

ari commented Mar 18, 2013

Happy with that for now. If we need to, we can reduce this to a smaller numbers of rows easily.

@ari ari closed this as completed Mar 18, 2013
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants