ml-pyxis

Tool for reading and writing datasets of tensors with MessagePack and Lightning Memory-Mapped Database (LMDB)


Keywords
python, data-science, data, machine-learning, deep-learning, lmdb, dataset, msgpack, dataset-manager
License
MIT
Install
pip install ml-pyxis==0.4.dev0

Documentation

ml-pyxis

Tool for reading and writing datasets of tensors in a Lightning Memory-Mapped Database (LMDB).

Installation

The installation instructions are generic and should work on most operating systems that support the prerequisites.

ml-pyxis requires Python version 2.7, 3.4, or above. We recommend installing ml-pyxis, as well as all prerequisites, in a virtual environment via virtualenv.

Prerequisites

The following Python packages are required to run ml-pyxis:

Please refer to the individual packages for more information about additional dependencies and how to install them for your operating system.

Bleeding-edge installation

To install the latest version of ml-pyxis, run the following command:

pip install --upgrade https://github.com/vicolab/ml-pyxis/archive/master.zip

Add the --user tag if you want to install the package in your home directory.

Development installation

ml-pyxis can be installed from source in such a way that any changes to your local copy will take effect without having to reinstall the package. Start by making a copy of the repository:

git clone https://github.com/vicolab/ml-pyxis.git

Next, enter the directory and install ml-pyxis in development mode by issuing the following command:

cd ml-pyxis
python setup.py develop