clusterjob

Python library to manage workflows on traditional HPC cluster systems.

The library provides the JobScript class that wraps around shell scripts, allowing them to be submitted to a local or remote HPC cluster scheduling system. The resource requirements (nodes, CPUs, runtime, etc.) for the scheduler are stored in the attributes of the JobScript object.

Read the full documentation on ReadTheDocs

At present, the following schedulers are supported:

• SLURM (default)
• Torque/PBS
• PBS Pro
• LPBS
• LSF
• Sun Grid Engine (SGE) (deprecated)

Support for the Univa Grid Engine (UGE) is planned.

Installation

pip install clusterjob