datacoco-batch

Data common code for batch workflows by Equinox


Keywords
helper, config, logging, common, batch, data-common-code, python3
License
MIT
Install
pip install datacoco-batch==0.1.2

Documentation

datacoco-batch

PyPI Version Documentation Status Code Quality Grade Coverage Code of Conduct

Batch is a simple interface for managing the state of jobs and workflows in batchy microservice.

Installation

datacoco-batch requires Python 3.6+

python3 -m venv <virtual env name>
source <virtual env name>/bin/activate
pip install datacoco-batch

Quickstart

self.batchy = Batch(
            wf=test_workflow,
            server="server.com",
            port="80",
        )

self.batchy.open()

self.batchy.get_status()

self.batchy.close()

Sample output

{
    "global": {
        "batch_id": "123456789",
        "status": "success",
        "failure_cnt": 0,
        "open_cnt": 2,
        "batch_start": "2020-01-17T06:58:01.234567",
        "batch_end": "2020-01-17T07:18:08.012345"
        }
    }

Development

Getting Started

It is recommended to use the steps below to set up a virtual environment for development:

python3 -m venv <virtual env name>
source <virtual env name>/bin/activate
pip install -r requirements.txt

Testing

pip install -r requirements-dev.txt

To run the testing suite, simply run the command: tox or python -m unittest discover tests

Contributing

Contributions to datacoco_batch are welcome!

Please reference guidelines to help with setting up your development environment here.