[Improvement]: Improve worker message passing to reduce memory leak #41845
Labels
Lang/Workers
Workers and Worker Interaction related issues
Team/jBallerina
All the issues related to BIR, JVM backend code generation and runtime
Type/Improvement
Description
$subject
Describe your problem(s)
The following code which passes 10KB json data between 3 workers increases the memory usage over time.
The heap dump shows a large count of
WorkerDataChannel
objects.Memory graph :
![Screenshot 2023-12-07 at 16 49 09](https://private-user-images.githubusercontent.com/28644893/288740354-243be6bf-e149-41e2-a589-6f575dc0118f.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjAxMjk5MDQsIm5iZiI6MTcyMDEyOTYwNCwicGF0aCI6Ii8yODY0NDg5My8yODg3NDAzNTQtMjQzYmU2YmYtZTE0OS00MWUyLWE1ODktNmY1NzVkYzAxMThmLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MDQlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzA0VDIxNDY0NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTMyZDA0YjY1ZmE5ZjIxN2YxZjA4MTE5NjQ3ZTEwOWEwZTcwNTVmZGUyNDU2NWNjZGM2MDI1ZjFlNWM0YzlkOTYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.tTFBFaXz3Las3JporRMHY56GPPP6LdGWbvg09YMb7kA)
Heap dump :
![Screenshot 2023-12-07 at 16 48 59](https://private-user-images.githubusercontent.com/28644893/288740537-ecd57b9d-b334-4fb0-b937-bdb5e9941079.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjAxMjk5MDQsIm5iZiI6MTcyMDEyOTYwNCwicGF0aCI6Ii8yODY0NDg5My8yODg3NDA1MzctZWNkNTdiOWQtYjMzNC00ZmIwLWI5MzctYmRiNWU5OTQxMDc5LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA3MDQlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNzA0VDIxNDY0NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTMyMmQwNWQwMzg0Y2E1NzA4YzU3NGUzMTQ3ZGZiNDZkZmUwNTEzNGRkYTliNGJiODg1YWVhNmY5MWZmYTcxNTEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.EkqcuwCdCHDe1PSAdbdx8gzHbIu-5umbOyGlHqzObUg)
Heap dump file :
https://drive.google.com/file/d/1dXK7C2tZiPxXkHsfhEYhXgRaG7y_Datw/view?usp=sharing
Describe your solution(s)
Clean up the channels & channel details.
Related area
-> Runtime
Related issue(s) (optional)
No response
Suggested label(s) (optional)
No response
Suggested assignee(s) (optional)
No response
The text was updated successfully, but these errors were encountered: