zerocopy

Zero-copy model loading for PyTorch and Ray.


License
Apache-2.0
Install
pip install zerocopy==0.1.0

Documentation

zero-copy-model-loading

Code to accompany the Medium post, "How to Load PyTorch Models 340 Times Faster with Ray".

Notebooks

Notebooks can be found in the notebooks directory:

  • zero_copy_loading.ipynb: The notebook that was used when authoring the original blog post.

Instructions to run notebooks:

  1. Install bash and either anaconda or miniconda.
  2. Check out a copy of this repository and navigate to the root directory of your local copy.
  3. Run the script ./env.sh, which creates an Anaconda environment under <root of your local copy>/env.
    ./env.sh
    
  4. Activate the Anaconda environment:
    conda activate ./env
    
  5. Run JupyterLab:
    jupyter lab
    
  6. Navigate to the notebooks directory and open up the Jupyter notebook of your choice.

Python Package