Tests in aggregator_test are flaky

[SaxyPandaBear]

This was attempted to be addressed in #334, and is tidied up, but the test is still flaky

[SaxyPandaBear]

An example test failure in CI can be found here. This should be investigated soon so there are less blips in GitHub actions when running PRs and merging to the main branch.

[SaxyPandaBear]

Note that increasing the timeouts as part of #366 has alleviated this a little bit, but the tests are stilly flaky

[github-actions]

This issue was marked stale due to lack of activity.

[SaxyPandaBear]

Closed by #619