Open source library for creating MXNet containers for serving on SageMaker.

pip install sagemaker-mxnet-inference==1.5.1


SageMaker MXNet Inference Toolkit

SageMaker MXNet Inference Toolkit is an open-source library for serving MXNet models on Amazon SageMaker. This library provides default pre-processing, predict and postprocessing for certain MXNet model types and utilizes the SageMaker Inference Toolkit for starting up the model server, which is responsible for handling inference requests.

For training, see SageMaker MXNet Training Toolkit.

For the Dockerfiles used for building SageMaker MXNet Containers, see AWS Deep Learning Containers.

For information on using MXNet on Amazon SageMaker, please refer to the SageMaker Python SDK documentation.


Please read for details on our code of conduct, and the process for submitting pull requests to us.


SageMaker MXNet Containers is licensed under the Apache 2.0 License. It is copyright 2019, Inc. or its affiliates. All Rights Reserved. The license is available at: