Local-LLM is a llama.cpp server in Docker with OpenAI Style Endpoints.


Install
pip install local-llm==0.1.1