clusterjob
Python library to manage workflows on traditional HPC cluster systems.
The library provides the JobScript
class that wraps around shell scripts,
allowing them to be submitted to a local or remote HPC cluster scheduling
system. The resource requirements (nodes, CPUs, runtime, etc.) for the scheduler
are stored in the attributes of the JobScript object.
Read the full documentation on ReadTheDocs
At present, the following schedulers are supported:
- SLURM (default)
- Torque/PBS
- PBS Pro
- LPBS
- LSF
- Sun Grid Engine (SGE) (deprecated)
Support for the Univa Grid Engine (UGE) is planned.
Installation
pip install clusterjob