zero-copy-model-loading
Code to accompany the Medium post, "How to Load PyTorch Models 340 Times Faster with Ray".
Notebooks
Notebooks can be found in the notebooks
directory:
-
zero_copy_loading.ipynb
: The notebook that was used when authoring the original blog post.
Instructions to run notebooks:
- Install
bash
and eitheranaconda
orminiconda
. - Check out a copy of this repository and navigate to the root directory of your local copy.
- Run the script
./env.sh
, which creates an Anaconda environment under<root of your local copy>/env
../env.sh
- Activate the Anaconda environment:
conda activate ./env
- Run JupyterLab:
jupyter lab
- Navigate to the
notebooks
directory and open up the Jupyter notebook of your choice.