Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add _gc path to xml scans #12

Closed
5 tasks done
durack1 opened this issue Jun 30, 2015 · 0 comments
Closed
5 tasks done

Add _gc path to xml scans #12

durack1 opened this issue Jun 30, 2015 · 0 comments
Assignees
@durack1

Comments

@durack1
Copy link
Owner

durack1 commented Jun 30, 2015

@painter1 has just alerted me that a new directory structure will be created during the process of scratch data sanitation..

Existing directories with problematic data such as:
/cmip5_css01/scratch/cmip5/output1/MRI
/cmip5_css01/scratch/cmip5/output1/LASG-CESS/
will become
/cmip5_css01/scratch/_gc/*/cmip5/output1/MRI
/cmip5_css01/scratch/_gc/to_keep/cmip5/output1/LASG-CESS/

These additional paths will need to be added to the existing search as 105k of the 145k local xmls point to data in scratch either on css01 or css02

  • fix var count not obtained from list_vars
  • add PID of master process to logfile contents (not just filename)/sendmail output
  • generalize DRS components assuming cmip[5-6]/output[0-9] placeholder for index
  • list matching of version (and variable) - so that paths are recognized rather than hard-coded
  • PID test for existing run - prevent xml over runs
@durack1 durack1 self-assigned this Jun 30, 2015
durack1 added a commit that referenced this issue Jul 13, 2015
@durack1
fix #12 - Added additional comments
d55aa6f
durack1 added a commit that referenced this issue Jul 13, 2015
@durack1
fix #12 - Added tweaks to output[1-3] DRS identifier to deal with CSI…
93ba9e2 
…RO-Mk3-6-0 data
durack1 added a commit that referenced this issue Jul 16, 2015
@durack1
Fix #12 - Updated to include explicit _gc dir scan
f6da227
durack1 added a commit that referenced this issue Jul 16, 2015
@durack1
Merge pull request #14 from durack1/issue12_durack1_fixNew_gc_Path
636ac34 
Fix #12 - Updated to include explicit _gc dir scan
durack1 added a commit that referenced this issue Jul 16, 2015
@durack1
Fix #12 - Updated to include explicit css01 _gc dir scan
9ce93c1
durack1 added a commit that referenced this issue Jul 16, 2015
@durack1
Merge pull request #15 from durack1/issue12_durack1_fixNew_gc_Path
979e7e1 
Fix #12 - Updated to include explicit css01 _gc dir scan
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@durack1 durack1

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@durack1