Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
Fix the SQL join query partition error when deal with too small testdata #207
This PR fixed Issue #193.
Bug description: The original code cannot well handle too small test data for spatial join query. When the user provides some super small test data, (2 or 3 rows per DataFrame), the partition number logic will jump in a wrong fallback setting and eventually pick "-1" as the partition number.
Solution: use a smarter Partition Number Optimizer to select a proper partition number for both input tables of a spatial join query.