Blowpipe is a tool to create and manage data pipelines, called Workflows. Each Step in a Workflow is implemented as a Container.
It began as an exercise in gaining a better understanding of data processing with forced isolation between Steps and has grown a bit in scope since then.
The arbitrary restriction of isolation means we get to investigate the impact in terms of design and implementation of data processing pipelines when your unit of code becomes a container.
It's a work in progress.
pip install blowpipe
This is an open-source piece of software - I encourage you to take part! - please read the
to get started, then fork and PR away.