What happened:
Try to pass a distributed.Security object to a custom implementation of the JobQueueCluster.
Hit the following error:
/var/conductor/miniconda-4.8.2-x86_64/anaconda/envs/dask-cpu-env/lib/python3.7/site-packages/distributed/comm/tcp.py in _expect_tls_context(connection_args)
311 "TLS expects a ssl_context argument of type "
312 "ssl.SSLContext (perhaps check your TLS configuration?)"
--> 313 " Instead got %s" % str(ctx)
314 )
315 return ctx
TypeError: TLS expects a ssl_context argument of type ssl.SSLContext (perhaps check your TLS configuration?) Instead got None
What you expected to happen:
Expect that the cluster is able to start with the specified security settings.
Tried LocalCluster and was able to start the cluster with TLS.
Minimal Complete Verifiable Example:
sec = Security(tls_ca_file='cacert.pem',
tls_client_cert='public.pem',
tls_client_key='keyfile.key',
tls_scheduler_cert='public.pem',
tls_scheduler_key='keyfile.key',
tls_worker_cert='public.pem',
tls_worker_key='keyfile.key')
cluster = MyCluster(security=sec)Anything else we need to know?:
Found that the JobQueueCluster does not appear to pass the security parameter from it's __init__ method to the SpecCluster __init__.
Locally edited JobQueueCluster to pass the security object and was able to get past this error:
super().__init__(
scheduler=scheduler,
worker=worker,
loop=loop,
silence_logs=silence_logs,
asynchronous=asynchronous,
name=name,
)
Environment:
- Dask version: distributed 2.15.0 and dask-jobqueue 0.7.1
- Python version: 3.7
- Operating System: Linux
- Install method (conda, pip, source): conda
What happened:
Try to pass a distributed.Security object to a custom implementation of the JobQueueCluster.
Hit the following error:
What you expected to happen:
Expect that the cluster is able to start with the specified security settings.
Tried LocalCluster and was able to start the cluster with TLS.
Minimal Complete Verifiable Example:
Anything else we need to know?:
Found that the JobQueueCluster does not appear to pass the security parameter from it's
__init__method to the SpecCluster__init__.Locally edited JobQueueCluster to pass the security object and was able to get past this error:
Environment: