Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
[YSQL] Support txn batch size for COPY to improve performance #2855
Today for improving COPY performance, we have a non-txn-copy gflag that can be used to run copy in non transactional mode. However, this does not take effect if table requires transactions (for example, if table has an index).
We should add a copy_txn_batch_size option to improve COPY performance for such transactional tables. This will reduce the batch size for transactions instead of loading all the data in a single large transaction.