ppqueue

A Parallel Process Queue for Python.


Keywords
multiprocessing, parallel, python, queue, threading, visualization
License
Other
Install
pip install ppqueue==0.4.0

Documentation

ppqueue

A Parallel Process Queue for Python.

Links
Code Repo https://www.github.com/fresh2dev/ppqueue
Mirror Repo https://www.f2dv.com/r/ppqueue
Documentation https://www.f2dv.com/r/ppqueue
Changelog https://www.f2dv.com/r/ppqueue/changelog
License https://www.f2dv.com/r/ppqueue/license
Funding https://www.f2dv.com/fund

GitHub release (latest SemVer) GitHub Release Date License GitHub Repo stars GitHub issues GitHub pull requests PyPI - Downloads Docker Pulls Changelog Funding


Overview

ppqueue is a Python module that serves as an abstraction layer to both multiprocessing.Process and threading.Thread. I built ppqueue because I too often notice that parallelizing code results in ugly code. With this simple Queue, you can parallelize code easily and attractively. ppqueue offers:

  • a single API for parallel execution using processes or threads.
  • FIFO priority queueing.
  • Gantt charts of job execution (thanks plotnine + pandas)
  • progress bars (thanks to tqdm)

Install

Install from PyPi:

pip install ppqueue[plot]

Examples

An notebook of examples is available at:

https://www.f2dv.com/code/r/ppqueue/i/page/examples/

And more examples are provided in the reference docs:

https://www.f2dv.com/code/r/ppqueue/i/reference/

Support

If this project delivers value to you, please provide feedback, code contributions, and/or funding.


Brought to you by...