#6853 Adding store tests for data column pruning

[SunnysidedJ]

Issue Addressed

#6853 Update store tests to cover data column pruning

Proposed Changes

Created a helper function check_data_column_existence which is a copy of check_blob_existence but checking data columns instead.
The helper function is then used to check whether data columns are also pruned when blobs are pruned if PeerDAS is enabled.

Additional Info

There were three bugs discovered when writing these tests

1. Data column info was not updated post fulu
2. Blob info was continuing to be updated post fulu
3. delete_if was broken for leveldb

For bug 3, we now seek to the correct column before trying to delete values. The prune_blobs_across_fork_boundary test provides test coverage for this change. When there are both blobs and data columns in the blob store, delete_if properly prunes blobs (or data columns). Without seek blobs would never be pruned as soon as the first data column was inserted into the blob store

[jimmygchen]

Thanks for the PR @SunnysidedJ !

Please see my comments above and let me know if it's unclear or if you have any questions!

[SunnysidedJ]

Major changes:

• Separated tests for data column pruning.
• Blob pruning tests only run on Deneb while column ones only run on Fulu with PeerDAS enabled.
• Found that fork_boundary test is not working (see inline comments).

[SunnysidedJ]

When I enable Fulu and try blob pruning, the blobs aren't pruned correctly. It'd be appreciated if you could have a look on the commit that reproduces the problem: SunnysidedJ@6217cf9

[mergify]

Some required checks have failed. Could you please take a look @SunnysidedJ? 🙏

[mergify]

Hi @SunnysidedJ, this pull request has been closed automatically due to 30 days of inactivity. If you’d like to continue working on it, feel free to reopen at any time.

[eserilev]

I'm going to take a look at the fulu blob pruning test issues

[eserilev]

The test is now passing. The reason it was failing was two fold:

• we werent advancing the slot clock before extending the chain
• we tried to fork from deneb directly to fulu

I've added an intermediary step to fork to electra and run some checks there. Not sure if theres any additional checks we want to make in this test.

[mergify]

Some required checks have failed. Could you please take a look @SunnysidedJ? 🙏

[eserilev]

ah still need to fix one other test, working on that now

[mergify]

This pull request has been removed from the queue for the following reason: pull request dequeued.

Pull request #7228 has been dequeued. The pull request could not be merged. This could be related to an activated branch protection or ruleset rule that prevents us from merging. (details: 1 review requesting changes and 1 approving review by reviewers with write access.).

You can check the last failing draft PR here: #8209.

You should look at the reason for the failure and decide if the pull request needs to be fixed or if you want to requeue it.
If you do update this pull request, it will automatically be requeued once the queue conditions match again.
If you think this was a flaky issue instead, you can requeue the pull request, without updating it, by posting a @mergifyio requeue comment.

[mergify]

This pull request has been removed from the queue for the following reason: checks timeout.

The merge conditions cannot be satisfied due to checks timeout:

You can check the last failing draft PR here: #8212.

You may have to fix your CI before adding the pull request to the queue again.

If you update this pull request, to fix the CI, it will automatically be requeued once the queue conditions match again.
If you think this was a flaky issue instead, you can requeue the pull request, without updating it, by posting a @mergifyio requeue comment.

[jimmygchen]

@mergify requeue

[mergify]

requeue

✅ The queue state of this pull request has been cleaned. It can be re-embarked automatically

[mergify]

This pull request has been removed from the queue for the following reason: pull request dequeued.

Pull request #7228 has been dequeued. The pull request could not be merged. This could be related to an activated branch protection or ruleset rule that prevents us from merging. (details: 1 review requesting changes and 1 approving review by reviewers with write access.).

You can check the last failing draft PR here: #8220.

You should look at the reason for the failure and decide if the pull request needs to be fixed or if you want to requeue it.
If you do update this pull request, it will automatically be requeued once the queue conditions match again.
If you think this was a flaky issue instead, you can requeue the pull request, without updating it, by posting a @mergifyio requeue comment.

outdated and been rereviewed