Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Spill batch 0 and move striping to loading (from build)
Spilling of batch 0 for parallel hash join is now implemented. While working on this, it occurred to us that explicit striping during the build phase was not required. This patch splits tuples into work_mem sized stripes while loading them. This is done exclusively for fallback batches, so normal hashjoins will not incur the overhead. There are two major items (that I know about) that still need to be dealt with: - Pausing and resuming loading for each stripe For now, I added a new STS mode called Append to support the current "overflow" design, however, I have other design proposals - parallel stripe instrumentation needs to change (I have design proposals for that). This commit also comments out a test which inserts tuples larger than work_mem in size (each), which no longer successfully executes. Co-authored-by: Soumyadeep Chakraborty <soumyadeep2007@gmail.com>
- Loading branch information