Allows simple command line usage of ApScheduler to add tasks directly to Dramatiq. It is designed to support multiple concurrent scheduler process such as in the case of Elastic Beanstalk.
You can run multiple process and each one will check if it's the leader before executing any tasks.
The application uses rabbitmq and redis.
By default both rabbitmq and redis will just use localhost but on most systems you are running these services on another server. You can configure both redis and rabbitmq by providing the connection urls as options
rabbitmq or environment variables
Below is a minimal example of the config. To add more tasks just simply edit the
jobs config option.
jobs: trigger_feed_run_every_10_minutes: func: run_feeds crontab: "*/10 * * * *" trigger_test_task: func: test_task crontab: "*/1 * * * *" queue_name: test
Currently only one trigger is supported
crontab. We recommend you use https://crontab.guru/ to validate your expressions.
Just run the task to start the process. You can also add the
--debug flag to get extra logging.
Usage: dramatiq_apscheduler [OPTIONS] TASK_FILE Options: --debug Enables debug logging --rabbitmq TEXT rabbitmq connection url: amqp://127.0.0.1:5672/ --redis_url TEXT redis connection url: redis://localhost/ --expire INTEGER How long the lock should last for --help Show this message and exit.
You can run with the demo config:
The easiest way to develop this application is in a venv. You can see more details in the click documentation but if your venv is setup just run the below command.
pip install --editable .
A docker image is also provided which allows you to easily run the application anywhere.
docker pull scollins/dramatiq-apscheduler docker run scollins/dramatiq-apscheduler