Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dynamic parsing job launch based on available memory #726

Open
mcserep opened this issue Mar 19, 2024 · 0 comments
Open

Dynamic parsing job launch based on available memory #726

mcserep opened this issue Mar 19, 2024 · 0 comments

Comments

@mcserep
Copy link
Collaborator

mcserep commented Mar 19, 2024

Currently, CodeCompass_parser can be parametrized with the -j <N> flag to specify to number of parsing jobs, which could be executed concurrently.

However, for some parsers (e.g. the cpp plugin), it can occur that parsing a translation unit requires large amount (multiple GBs) of RAM. The aim of this issue is to add an additional dynamic guard when starting a new parsing job. In case the available free memory is too low (needs to be specified), then the job shall not be started.

The feature has to be implemented to support both Linux (Ubuntu) and also macOS - related to #637.

In case fetching the free memory is uneasy, as an alternative approach, it would also be valid to measure the allocated memory by the CodeCompass_parser, and enforce an upper threshold based on that value.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: To do
Lab
To do
Development

No branches or pull requests

1 participant