What high priority scheduler issues remain to be resolved?

[jchodera]

We have sometime left with Adaptive Computing to resolve additional issues.

Besides the scheduler segfault issue (#172), what other high priority issues do we have?

[tatarsky]

I have the list of open bugs which are

-qdel -t doesn't work #167 (workaround however exists)
-the cuda_visible_devices bug (workaround in place but would be nice to get fixed in code)
-I am not clear on #138 and its status

I've suggested a review of fairshare configs as the most "common" item that is referenced.

[tatarsky]

Ah, and #186 may be a bug but it may not be. I'm not sure on that one either.

[jchodera]

#147 also lists a number of open issues in addition to these:

• Fairshare needs to take group membership into account
• Short (<1h) jobs in the active queue (interactive jobs) should also be able to suspend batch jobs in order to find a slot more quickly.
• Jobs in the active queue should run as cpu overcommitment. They don't need a full CPU allocated. This takes into account that they are mostly idle. The number of interactive jobs allowed per user can be increased at that point.

[tatarsky]

Yep, I've already got those in the collection with them.

[tatarsky]

Fairshare BTW does take group membership into account. So I'd like further explanation or example where it is not as believed to be.

[jchodera]

We can probably also address #102 to optimize scheduling order

[jchodera]

OK, I think @tatarsky has the best handle on the order of priority here at this point. I'll write back to Rob and let him know you have a good idea of what order to tackle these things.

Thanks!

[tatarsky]

Yes, I wanted to basically comment out "ENABLEHIGHTHROUGHPUT TRUE" on that one and see if it improves or degrades the situation. But I'm trying to only make one mod at a time ;)

[tatarsky]

We are reviewing items and may make some one at a time changes at some point. But if we do they will be announced with a Git issue so that any issues with the mod can be tracked. This is unrelated to core dump matter. Which remains under investigation.

[tatarsky]

All items in this ticket are duplicated in other Git tickets or resolved.