Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Fix integer overflow when turning dictionary into direct #12015
Turning dictionary into direct in ORC writer can end up with writing
This commit fixed this by checking the written size after each batch of
The batch size is fixed to 1024, which can be still too large in theory, say the cell is a 8MB string.
I can see two solution
@dain , I am wondering you have any preference / suggestions?