A library of generic tools for ETL work and visualization of JSON blobs and python repositories.


Keywords
ETL, blob, dependency, graph, svg, networkx, transform, json-blobs, visualization
License
MIT
Install
pip install rolling-pin==0.3.2

Documentation

Rolling-Pin

A library of generic tools for ETL work and visualization of JSON blobs and python repositories

Documentation

On the documentation main page, under the Architecture section, is a dynamically generated dependency graph of rolling-pin's current architecture. It is generated using the RepoETL class.

If you look under the Metrics section you will find Radon code metric plots and data of the rolling-pin source code, generated by the RadonETL class.

Jupyter Notebook Demo

Installation

pip install rolling-pin

For Developers

Installation

  1. Install docker
  2. Install docker-machine (if running on macOS or Windows)
  3. Ensure docker-machine has at least 4 GB of memory allocated to it.
  4. cd rolling-pin
  5. chmod +x bin/rolling-pin
  6. bin/rolling-pin start

The service should take a few minutes to start up.

Run bin/rolling-pin --help for more help on the command line tool.

Conda Environment Creation

Running a conda environment is not recommended.

However, if you would still like to build one, do the following:

  1. conda create -y -n rolling-pin-env python==3.7
  2. source activate rolling-pin-env
  3. pip install -r docker/dev_requirements.txt
  4. pip install -r docker/prod_requirements.txt