Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase max vrepl workflow source definition size from 64KiB to 16MiB #10018

Merged
merged 1 commit into from
Apr 14, 2022

Conversation

mattlord
Copy link
Contributor

@mattlord mattlord commented Mar 31, 2022

Description

If you have a large number of tables and or shards involved in a vreplication workflow then you can bump into the existing 64KiB limit for the source definition. Moving the source column to MEDIUMBLOB increases the maximum size to 16MiB which should easily cover any reasonable definition.

Related Issue(s)

Checklist

  • Should this PR be backported? No
  • Tests are not required
  • Documentation is not required

This will allow us to avoid practical limits on the number of shard
and table definitions in workflows.

Signed-off-by: Matt Lord <mattalord@gmail.com>
Copy link
Contributor

@rohit-nayak-ps rohit-nayak-ps left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@mattlord mattlord merged commit 41226b5 into vitessio:main Apr 14, 2022
@mattlord mattlord deleted the vrepl_source_mediumblob branch April 14, 2022 14:54
notfelineit pushed a commit to planetscale/vitess that referenced this pull request May 3, 2022
… (vitessio#558)

This will allow us to avoid practical limits on the number of shard
and table definitions in workflows.

Signed-off-by: Matt Lord <mattalord@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants