fix: fix hash join spilling hang and add more tests

[xudong963]

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

• resolve hang for multiple table join

• add some tpch queries to test join spilling

• add a setting about join spilling partition number

• Fixes #[Link the issue here]

Tests

• Unit Test
• Logic Test
• Benchmark Test
• No Test - Explain why

Type of change

• Bug Fix (non-breaking change which fixes an issue)
• New Feature (non-breaking change which adds functionality)
• Breaking Change (fix or feature that could cause existing functionality not to work as expected)
• Documentation Update
• Refactoring
• Performance Improvement
• Other (please describe):

---

This change is 

[github-actions]

Docker Image for PR

• tag: pr-14794-1cecdc5

note: this image tag is only available for internal use,
please check the internal doc for more details.

[github-actions]

Docker Image for PR

• tag: pr-14794-99f6170

note: this image tag is only available for internal use,
please check the internal doc for more details.

[github-actions]

Docker Image for PR

• tag: pr-14794-137ac11

note: this image tag is only available for internal use,
please check the internal doc for more details.

[github-actions]

ClickBench Report

• hits: https://benchmark.databend.rs/clickbench/pr/14794/8112490416/hits.html
• internal: https://benchmark.databend.rs/clickbench/pr/14794/8112490416/internal.html
• tpch: https://benchmark.databend.rs/clickbench/pr/14794/8112490416/tpch.html

[github-actions]

Docker Image for PR

• tag: pr-14794-10ceec9

note: this image tag is only available for internal use,
please check the internal doc for more details.

[github-actions]

Docker Image for PR

• tag: pr-14794-8999a41

note: this image tag is only available for internal use,
please check the internal doc for more details.

[github-actions]

Docker Image for PR

• tag: pr-14794-a645f05

note: this image tag is only available for internal use,
please check the internal doc for more details.

[github-actions]

Docker Image for PR

• tag: pr-14794-a8fe909

note: this image tag is only available for internal use,
please check the internal doc for more details.

[github-actions]

Docker Image for PR

• tag: pr-14794-307df40

note: this image tag is only available for internal use,
please check the internal doc for more details.

[xudong963]

I did a large join test on the XSAMLL warehouse:

SELECT
  *
FROM
  lineitem AS l1
  INNER JOIN lineitem AS o ON (l1.l_orderkey * 70000 = o.l_partkey)

lineitem contains ~600million rows. If there is no spilling, it'll OOM quickly.

After set join_spilling_memory_ratio = 60; It will run successfully!

deploy@(test_spill_xd_4)/xd_tpch100p> SELECT * FROM lineitem as l1 INNER JOIN lineitem AS o ON (l1.l_orderkey * 70000 = o.l_partkey) ;

SELECT
  *
FROM
  lineitem AS l1
  INNER JOIN lineitem AS o ON (l1.l_orderkey * 70000 = o.l_partkey)

8682 rows read in 1532.381 sec. Processed 1.2 billion rows, 215.47 GiB (783.14 thousand rows/s, 143.98 MiB/s)