pb_job_manager

A utility class to run plumbum commands concurrently


Keywords
plumbum, shell, popen, process, subprocess, multiprocess
License
BSD-3-Clause
Install
pip install pb_job_manager==0.2.2

Documentation

Plumbum Job Manager

A utility class to run plumbum commands concurrently

https://secure.travis-ci.org/mbarkhau/pb-job-manager.png

Fire and forget Multiple Commands

import plumbum as pb
from pb_job_manager import PBJobManager
pbjm = PBJobManager(max_procs=4)
pbjm.add_job(pb.cmd.grep["foo", "input.txt"] | pb.cmd.sort > "foo.txt")
pbjm.add_job(pb.cmd.grep["bar", "input.txt"] | pb.cmd.sort > "bar.txt")
pbjm.add_job(pb.cmd.grep["baz", "input.txt"] | pb.cmd.sort > "baz.txt")
pbjb.run()   # run until all jobs are finished

Creating Jobs with Callbacks

::
TODO: Example

Jobs with dependencies

::
TODO: Example

Result Iteration

::
TODO: Example