Local-LLM is a llama.cpp server in Docker with OpenAI Style Endpoints.
PyPI
pip install local-llm==0.1.1
Login to resync this project