PBSCluster is not awaitable

[aidanheerdegen]

It would be great to use PBSCluster with dask-labextension but for this to work PBSCluster has to be able to be used asynchronously, so has to support await

dask/dask-labextension#36

When I tried specifying PBSCluster in my ~/.dask/config:

labextension: 
  factory: 
    args: []
    class: PBSCluster
    module: dask_jobqueue
    kwargs: 
      cores: 8
      jobextra: 
        - "-P v45"
      memory: 16GB
      processes: 8
      queue: expressbw
      resource_spec: 'ncpus=8,mem=16G'

I got an error:

[W 13:05:24.228 LabApp] object PBSCluster can't be used in 'await' expression

[guillaumeeb]

That's quite possible that dask-jobqueue is not currently compatible. I have to admit my lack of knowledge with async programing. Work has been done with dask-kubernetes here as you're probably aware through the dask-labextension issue.

Would you want to give a try on the equivalent for dask-jobqueue?

[aidanheerdegen]

I have attempted this, but no luck so far. I'll try and find time to work on it next week.

[guillaumeeb]

@mrocklin, should be fixed by #307 if I'm not mistaken?

[lesteve]

@mrocklin, should be fixed by #307 if I'm not mistaken?

That's my understanding as well.

[mrocklin]

Yes

[guillaumeeb]

Fixed by #307