Commit with deletions is very slow

[swingbit]

Describe the bug
Committing a transaction that has removed a considerable amount of rows takes longer than reasonable.

To Reproduce

set optimizer='sequential_pipe';

start transaction;

-- a table with 100M random integers, with about 10M unique values
CREATE TABLE x AS
  SELECT rand() % (10 * 1000 * 1000) as a1
  FROM sys.generate_series(1, (100 * 1000 * 1000));

-- without this delete (about 10%), the commit takes less than 1s
-- with the delete, the commit takes forever (I had to kill the server after waiting longer than 30 minutes)

-- DELETE FROM x
-- WHERE a1 in (SELECT rand() % (10 * 1000 * 1000) FROM sys.generate_series(1, (1000 * 1000)));

commit;

Software versions

• MonetDB version number 11.43.10
• OS and version: Fedora 35
• self-installed and compiled

[swingbit]

I tried to let it finish. It took 43 minutes.

[sjoerdmullender]

I believe this is now fixed.