Stats
Python parallel task-queue with redis
Based on
- rq
- redis
- gevent
Environment variables
-
PRQ_LOGS
- path to file with logs (512Mb data)
PipeLine
Every pipeline part use .wait()
to get result, if you want, it not block other task, task run in parallel.
Example to test
- Start worker
python prq.py --url redis://localhost:6379
(export python path before) 2. (a) Start pipeline (2 task)
python examples/pipeline/task_pipeline.py
- (b) Start another task in parallel execution
python examples/tasks/default_task.py