taskchain

Utility for running data and ML pipelines


License
MIT
Install
pip install taskchain==1.4.0

Documentation

TaskChain

Documentation

Install

pip install taskchain

From source

git clone https://github.com/flowerchecker/taskchain
cd taskchain
poetry install

Changelog

unpublished

  • allow to define multiple input task using regexp

1.2.1

  • fixes

1.2.0

  • remove redundant module taskchain.task
  • add support for task exclusion, just use exluded_tasks in your config
  • add tools for testing, check taskchain.utils.testing
  • finish documentation
  • remove some redundant methods

1.1.1

  • improve chain representation in jupyter
  • add tasks_df parameter to chains
  • add support for uses in contexts (same syntax as in configs)
  • improve create_readable_filenames
    • use config name as default name
    • better verbose mode
  • force method of both Chain and Task now supports delete_data parameter which delete persisted data
    • it defaults to False
    • be careful with this
  • add Makefile

1.1.0

  • release to PIP

1.0.3

  • more types can be used for run method, e.g. dict or Dict[str, int]
  • forbid some names of parameters with special meaning in configs (uses, tasks, ...)
  • you should import from taskchain instead of taskchain.taks, later is deprecated and will be removed
    • use from taskchain import Task, Config, Chain or import taskchain as tc; tc.Task
  • MultiChain are now more robust, you can use them with configs with context, and it will work correctly

Development

Release new version to PIP

make version-patch
# OR
make version-minor

make publish

Develop docs

run server which dynamically serves docs web.

make docs-develop

Build docs

Create documentation as static files.

make docs-build

Build docs

Builds documentation and deploys it to GitHub Pages

make make docs-publish