Optimum Neuron is the interface between the Hugging Face Transformers and Diffusers libraries and AWS Tranium and Inferentia accelerators. It provides a set of tools enabling easy model loading, training and inference on single and multiple neuron core settings for different downstream tasks.


Keywords
transformers, diffusers, mixed-precision, training, fine-tuning, inference, tranium, inferentia, aws
License
Apache-2.0
Install
pip install optimum-neuron==0.0.23