ayd

generate Azkaban Flow


License
MIT
Install
pip install ayd==0.0.1

Documentation

ayd

ayd generates Azkaban Flow based on Azkaban YAML DSL.

##Prerequisites Python 2.7

##Required Python Libraries

  • cliff
  • PyYAML

##Install

pip install ayd

Usage

  • aaa.yaml
foo:
  type: command
  command: echo "foo"
  retries: 1
  retry.backoff: 300000

bar:
  type: command
  command: echo "bar"
  dependencies: foo
  retries: 1
  retry.backoff: 300000

hoge:
  type: command
  dependencies: foo
  command: echo "hoge"
  command.1: echo "hoge1"
  retries: 2
  retry.backoff: 30000

piyo:
  type: command
  dependencies: bar, hoge
  command: echo "piyo"
  retries: 1
  retry.backoff: 300000
  • execute
ayd generateFlow --flowyaml aaa.yaml --outputdir aaa

then, Azkaban Flow is generated.

If you archive aaa directory and upload aaa.zip, Azkaban Flow is the following.

ayd

  • migrate

If you want to migrate Azkaban Job File, use migrate

ayd migrate --jobdir azkaban_job_dir --outputyaml aaa.yaml