DashInfer is a native inference engine for Pre-trained Large Language Models (LLMs) developed by Tongyi Laboratory.
PyPI
pip install dashinfer==2.1.0
Login to resync this project