LLM API for python
This python library connects to llm-api using python, it was build to mimic OpenAI's python library
Usage
You can install this library using pip
pip install llm-api-python
After running llm-api, simply configure your client as if it's OpenAI's python binding
import llm_api
llm_api.api_key = "<your llm-api api key here>"
completion = llm_api.ChatCompletion.create(messages=[
{
"role": "system",
"content": "You are a helpful assistant, please answer the users' questions with honesty and accuracy."
}, {
"role": "user", "content": "What is the capital of France?"
}
]) # returns a chat completion object
completion = llm_api.ChatCompletion.create(messages=[
...
], stream=True) # returns a generator
completion = await llm_api.ChatCompletion.acreate(messages=[
...
]) # returns a chat completion object
completion = await llm_api.ChatCompletion.acreate(messages=[
...
], stream=True) # returns a async generatorLimitations
-
request_idandrequest_msare currently returned empty -
createdtimestamp is not set by the server -
finish_reasonis hardcoded tostop -
usagevalues are set toNone - the
modelattribute is not being used
Credit
OpenAI's python implementation since this implementation is technically a fork of it.
