Skip to content

Latest commit

 

History

History
112 lines (72 loc) · 3.49 KB

cc_setup.rst

File metadata and controls

112 lines (72 loc) · 3.49 KB
Raw

Coffea-Casa Setup Without Dask Labextention ============

Preparations -----------

Please shut down UNL HTCondor Cluster (powered by Dask Labextention and available by default), by pushing the button labeled Shutdown:

Default Dask Labextention powered cluster available Coffea-casa Analysis Facility @ T2 Nebraska

Instantiating Your Own CoffeaCasaCluster -----------

The next snippet will set up a cluster by instantiating a Dask Client with CoffeaCasaCluster, scaled to use 10 jobs:

from distributed import Client
from coffea_casa import CoffeaCasaCluster

cluster = CoffeaCasaCluster()
cluster.scale(10)
client = Client(cluster)

You can use an adaptive mechanism for Dask job autoscaling. This will scale Dask workers automatically based on scheduler activity:

from distributed import Client
from coffea_casa import CoffeaCasaCluster

cluster = CoffeaCasaCluster()
cluster.adapt(minimum=4, maximum=10)
client = Client(cluster)

Note

Don't forget to shutdown your Coffea-casa cluster before starting a new one:

cluster.close()

CoffeaCasaCluster --------------

The default CoffeaCasaCluster constructor settings:

{
'protocol': 'tls://',
'security': Security(require_encryption=True,
                    tls_ca_file='/etc/cmsaf-secrets/ca.pem',
                    tls_client_cert='/etc/cmsaf-secrets/hostcert.pem',
                    tls_client_key='/etc/cmsaf-secrets/hostcert.pem',
                    tls_scheduler_cert='/etc/cmsaf-secrets/hostcert.pem',
                    tls_scheduler_key='/etc/cmsaf-secrets/hostcert.pem',
                    tls_worker_cert='/etc/cmsaf-secrets/hostcert.pem',
                    tls_worker_key='/etc/cmsaf-secrets/hostcert.pem'),
'log_directory': 'logs',
'silence_logs': 'DEBUG',
'scheduler_options': {'port': 8786,
'dashboard_address': '8787',
'protocol': 'tls',
'external_address': 'tls://oksana-2eshadura-40cern-2ech.dask.coffea.casa:8786'},
'job_extra': {'universe': 'docker',
              'docker_image': 'coffeateam/coffea-casa-analysis:0.2.23',
              'container_service_names': 'dask',
              'dask_container_port': 8786,
              'transfer_input_files': '/etc/cmsaf-secrets/ca.pem, /etc/cmsaf-secrets/hostcert.pem, /etc/cmsaf-secrets/xcache_token',
              'encrypt_input_files': '/etc/cmsaf-secrets/ca.pem, /etc/cmsaf-secrets/hostcert.pem, /etc/cmsaf-secrets/xcache_token',
              'transfer_output_files': '',
              'when_to_transfer_output': 'ON_EXIT',
              'should_transfer_files': 'YES',
              'Stream_Output': 'False',
              'Stream_Error': 'False',
              '+DaskSchedulerAddress': '"tls://oksana-2eshadura-40cern-2ech.dask.coffea.casa:8786"'}}

which you can easily adjust just passing appropriate arguments to CoffeaCasaCluster constructor:

cluster = CoffeaCasaCluster(cores=1, memory="10 GiB")

or

cluster = CoffeaCasaCluster(job_extra = {'docker_image': 'coffeateam/coffea-casa-analysis:latest')

Note

Coffea-casa is using communication through the TLS protocol. You will not be able to disable TLS!

To learn how to use Dask Labextention, please check cc_configuration.