Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[xy] Fix memory leak in data integration pipelines. #3641

Merged
merged 1 commit into from
Oct 2, 2023

Conversation

wangxiaoyou1993
Copy link
Member

@wangxiaoyou1993 wangxiaoyou1993 commented Oct 2, 2023

Description

Fix memory leak in data integration pipelines.
For SQL sources and destinations, close all the connections that weren't closed.

How Has This Been Tested?

Test data integration pipelines with the following source and destination locally

  • OracleDB destination
  • Postgres destination
  • Redshift destination
  • Snowflake destination
  • OracleDB source
  • Postgres source

Checklist

  • The PR is tagged with proper labels (bug, enhancement, feature, documentation)
  • I have performed a self-review of my own code
  • I have added unit tests that prove my fix is effective or that my feature works
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation

cc:

@wangxiaoyou1993 wangxiaoyou1993 added the bug Something isn't working label Oct 2, 2023
@wangxiaoyou1993 wangxiaoyou1993 merged commit 5c34359 into master Oct 2, 2023
11 checks passed
@wangxiaoyou1993 wangxiaoyou1993 deleted the xiaoyou/fix-data-integration-memory-leak branch October 2, 2023 07:03
@wangxiaoyou1993 wangxiaoyou1993 mentioned this pull request Oct 3, 2023
6 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant