llmdeploy

triton inference service of llama


Install
pip install llmdeploy==0.0.1