Boston University RCS Team collaboration for an intelligent resource prediction framework.
This work has been partially funded by Sandia National Laboratories.
The qsub_rec
module is designed for intelligent resource prediction within collaborative HPC environments.
It provides training and prediction scripts suitable for batch job submissions on the Boston University Shared Computing Cluster (BU SCC) system.
- π§Ή Data preprocessing utilities
- π Regression-based prediction algorithms
- π οΈ Model training and prediction tools
On the BU SCC system, include the module directory and load the module:
module use /share/module.8/test
module load qsub_rec/1.0
Train the model, once after module is loaded.
train_rec.py
To generate a new script with the recommended number of processors for your batch job:
qsub_rec.py
A new script will be created in the same directory as your batch job file, with suggested resource requests based on the model prediction.
For questions, issues or feedback, please contact boztop@bu.edu.