DashInfer is a native inference engine for Pre-trained Large Language Models (LLMs) developed by Tongyi Laboratory.
PyPI
pip install dashinfer==1.0.0
Login to resync this project