This Python 3 module enable to store large structure in a python pickle, in such a way that the array can be memory-mapped instead of being copied in memory. This module is licensed under the LGPL3 license.
Currently, the container has to be a dictionnary (
mmappickle.dict), which keys are strings of less than 256 bytes.
It supports any values, but it is only possible to memory-map numpy arrays and numpy masked arrays.
It also supports concurrent access (i.e. you can pass a
mmappickle.dict an argument which is called using the
multiprocessing Python module).
Documentation is available at http://mmappickle.readthedocs.io/
Please post issues and pull requests on github. Alternatively, you can also send your patches by email.