Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scheduler gives unnecessary warnings #29

Open
sestephens73 opened this issue Apr 5, 2021 · 2 comments
Open

Scheduler gives unnecessary warnings #29

sestephens73 opened this issue Apr 5, 2021 · 2 comments
Assignees
Labels
bug Something isn't working useability Something related to Parla programmer experience

Comments

@sestephens73
Copy link
Contributor

The scheduler gives unnecessary warnings when trying to assign tasks to processors. Also, the print format on these warning messages needs to be cleaned up.
Simple repro on Frontera:

cd Parla.py/benchmarks/qr_factorization
python qr_parla.py -r 1600000 -c 1000 -b 100000 -i 1 -p gpu -g 1

Once the GPU memory fills up, the scheduler warns that the rest of the tasks may not be able to be scheduled even though they definitely can once previous tasks complete.

It may be worthwhile to have two separate warnings: one that warns that a task can't be scheduled right now due to lack of resources, and a separate warning for when a task won't ever be able to be scheduled (e.g. because it requires a GPU and more memory than any GPU has due to the memory argument in spawn).

@sestephens73 sestephens73 self-assigned this Apr 5, 2021
@sestephens73
Copy link
Contributor Author

@arthurp @insertinterestingnamehere Is this something either of you would be able to take care of quickly, even if it's just a hack for me to disable the warnings on my end? I've got valid test cases that are printing the warning thousands of times and I'm concerned it's affecting my timing, so I need at least a temporary fix.

@arthurp
Copy link
Member

arthurp commented Apr 6, 2021

You can just comment the warning:

https://gist.github.com/arthurp/dd3585d264c8723e5bb61d71f11bcc62

@arthurp arthurp added bug Something isn't working useability Something related to Parla programmer experience labels Apr 30, 2021
@arthurp arthurp removed their assignment Apr 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working useability Something related to Parla programmer experience
Projects
None yet
Development

No branches or pull requests

3 participants