Skip to content

[Bug] PopenPool Worker Memory Leak Issue in Building #11096

@zxybazh

Description

@zxybazh

According to recent PRs #11094 #11074 , we found that multiple teams independently identified the same memory leak problem using PopenPool worker for tvm building during tuning.

Now the common workaround seems to be restarting the worker / Popen process pool after certain time of usage.
This issue is thus created to further investigate and track the root cause.

CC: @tqchen @junrushao1994 @shingjan @AndrewZhaoLuo @petersalas

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions