vllm-inference

Inference locally.


Install
pip install vllm-inference==0.0.19