Skip to content
This repository has been archived by the owner on Jan 31, 2022. It is now read-only.

Update clusterAnaScurve.py for new computing environment. #95

Closed
bdorney opened this issue May 18, 2018 · 2 comments
Closed

Update clusterAnaScurve.py for new computing environment. #95

bdorney opened this issue May 18, 2018 · 2 comments

Comments

@bdorney
Copy link
Contributor

bdorney commented May 18, 2018

Brief summary of issue

Since gem-plotting-tools has been updated to be more of a package that is installed or downloaded as a standalone release the clusterAnaScurve.py tool no longer properly sets up the computing env on the worker node of lxplus.

Additionally CERN IT is moving lxplus away from using the scheduler bsub to moving HTCondor:

http://batchdocs.web.cern.ch/batchdocs/

Now might be a good time to migrate to HTCondor.

Expected Behavior

The worker node on lxplus should:

  1. Download a given release and all supporting software,
  2. Unpack it and install it,
  3. Set the env
  4. Launch the analysis
  5. Return the results

You may have to adapt this procedure to instead download all tarballs/zip files, and then send them to the worker node instead of having the worker node do this.

Presently right now the worker node is using AFS directories this typically is "frowned" upon and angry emails may be sent from cluster administers. Perhaps we should alter this.

Current Behavior

The computing env setup by clusterAnaScurve.py is no longer compatible with how the package is installed as either a rpm, zip, or tarball. Specifically the following lines need to be updated:

# script to be run by the cluster
jobScriptName = "%s/clusterJob.sh"%dirPath
jobScript = open(jobScriptName, 'w+')
jobScript.write('#!/bin/zsh\n')
jobScript.write('source /opt/rh/python27/enable\n')
jobScript.write('source /afs/cern.ch/sw/lcg/contrib/gcc/4.8.4/x86_64-slc6/setup.sh\n')
jobScript.write('export BUILD_HOME=%s\n'%buildHome)
jobScript.write('export DATA_PATH=%s\n'%dataPath)
jobScript.write('export ELOG_PATH=%s\n'%elogPath)
jobScript.write('source %s/cmsgemos/setup/paths.sh\n'%buildHome)
jobScript.write('source %s/gem-plotting-tools/setup/paths.sh\n'%buildHome)
jobScript.write('source $BUILD_HOME/venv/slc6/py27/bin/activate\n')
jobScript.write('echo `python --version`\n')
jobScript.write('echo `gcc --version | grep "gcc"`\n')

Additionally the example shown in the README.txt needs to be updated:
https://github.com/cms-gem-daq-project/gem-plotting-tools/#full-example-for-p5-s-curve-data

Context (for feature requests)

Need cluster computing abilities to re-analyze all s-curve data taken in P5.

@bdorney
Copy link
Contributor Author

bdorney commented May 18, 2018

Partially related to:

#94

In that the documentation for using clusterAnaScurve.py may need to be updated.

@bdorney
Copy link
Contributor Author

bdorney commented Jun 28, 2018

Support for the lxplus batch submission system was added by #105. Given limited resources let's close this for now; it can be reopened later if HTCondor goes live.

@bdorney bdorney closed this as completed Jun 28, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

1 participant