aioworkerpool: async worker pool
Master/Worker pool for asyncio (PEP 3156).
Features
- Uses fork() to reuse python interpreter
- Supports proxying of stdout/stderr from workers to files
- Provides multiprocess-aware logging transport
- Supports file descriptor preserving
- May run as UNIX daemon
Library installation
$ pip install aioworkerpool
Getting started
Example (see quickstart.py)
.. literalinclude:: ../examples/quickstart.py :language: python
Running examples:
$ cd aioworkerpool
$ python -m examples.quickstart
Source code
- Hosted on GitHub.
- Uses Travis for continuous integration.
- Documentation on ReadTheDocs.
Dependencies
- POSIX operation system
- Python 3.5+ (basically, asyncio and async/await syntax)
- python-daemon
- tblib
Current development status
Library is under active development so API may change dramatically.
Contents
.. toctree:: :maxdepth: 2 master worker logging