Prem generic utils to use across Prem Components.


License
Apache-2.0
Install
pip install prem-utils==0.0.47

Documentation

🛠️ Prem Utils

Utilities, and Connectors in order to interact with all Model Serving and Fine-tuning Providers.

🗄️ Connectors

Name Status
Anthropic Active
OpenAI Active
Perplexity Active
Cohere Active
DeepInfra Deprecated
FireworksAI Deprecated
OctoAI Deprecated
Groq Active
Lamini Deprecated
Mistral Active
OpenRouter Active
Prem Active
Replicate Deprecated
Together Deprecated

🤙 Usage

pip install prem-utils
import asyncio
from inspect import iscoroutine
from prem_utils.connectors import openai

connector = openai.OpenAIConnector(api_key="")

prompt = "Hello, how are you?"
response = connector.chat_completion(model="gpt-3.5-turbo", messages=[{"role": "user", "content": prompt}])

if iscoroutine(response):
    response = asyncio.run(response)

message = response["choices"][0]["message"]["content"]
print(message)

📦 Contribute

Install the necessary dependencies

virtualenv venv -p=3.11
source venv/bin/activate
pip install -r requirements.txt

Test all or one connector

# will run all the connectors
python e2e.py

# only one connector
python e2e.py --name perplexity