Skip to content
This repository has been archived by the owner on Dec 21, 2021. It is now read-only.

NET-229: Fix Memleak(s) #236

Merged
merged 36 commits into from
Mar 29, 2021
Merged

NET-229: Fix Memleak(s) #236

merged 36 commits into from
Mar 29, 2021

Conversation

timoxley
Copy link
Contributor

@timoxley timoxley commented Mar 25, 2021

Fixes for #233.

Found two definite leaks, and a few minor potential leaks.
Resend's last option limits to 10,000 messages, but no such limit for resend from/to.
Resend limits for from/to with some kind of pagination like this stale PR would probably help a lot: streamr-dev/broker#190


CI failure due to production resends being broken.

Might have to figure out a good way to replay large datasets in test environment, it's quite possible my testing of this yesterday caused production resends to fall over. Of course this shouldn't happen at all, and we probably should do something to break up resends into smaller chunks, for the benefit of both producer and consumer.

@timoxley timoxley changed the title Fix Memleak(s) (WIP) NET-229: Fix Memleak(s) Mar 26, 2021
@linear
Copy link

linear bot commented Mar 26, 2021

NET-229 Address Memleak

Memleak reported here: #233

Confirmed memleak when running large resends against tramdata stream.

Fixed here: #236

@timoxley timoxley requested review from teogeb and harbu March 29, 2021 14:31
src/utils/PushQueue.ts Outdated Show resolved Hide resolved
@timoxley
Copy link
Contributor Author

CI failure seems unrelated, merging so we can put out a new, fixed 5.x release.

@timoxley timoxley merged commit 08abe11 into master Mar 29, 2021
@timoxley timoxley deleted the memleak2 branch March 29, 2021 18:40
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants