airflow-dag-deployer

To deploy projects dags to airflow dag directory


License
GPL-3.0
Install
pip install airflow-dag-deployer==0.5

Documentation

Installation

pip install airflow-dag-deployer

Deploy dags with commandline

Dags can be deployed as zip archive or independent python file prefixed by project name.

Deploying dags as a zip archive

deploydag --project=<project_name> --source=<dags_dir> --destination=<airflow_home> --method=zip

Deploying dags as a file

deploydag --project=<project_name> --source=<dags_dir> --destination=<airflow_home> --method=file

Deploying dags with config file for different environments

Set up of different deployment environment (dev/test/prod)

Have a deploydag.json (or any filename with json setting) file like this:

{
  "dev": {
    "project": "testproject",
    "source": "dags",
    "destination": "airflowhome",
    "method": "zip"
  }
}

Run command like this:

deploydag --config=deploydag.json --env=dev