Install this plugin in the same environment as LLM. From the current directory
llm install llm-watsonxYou will need to provide the following:
- API Key from IBM Cloud IAM: https://cloud.ibm.com/iam/apikeys
- Project ID (from watsonx.ai instance URL: https://dataplatform.cloud.ibm.com/projects//)
export WATSONX_API_KEY=
export WATSONX_PROJECT_ID=- Optionally, if your watsonx instance is not in
us-south:
export WATSONX_URL=Get list of commands:
llm watsonx --helpSee all available models:
llm watsonx list-modelsSee all generation options:
llm watsonx list-model-optionsllm -m watsonx/meta-llama/llama-3-8b-instruct \
-o temperature .4 \
-o max_new_tokens 250 \
"What is IBM watsonx?"llm chat -m watsonx/meta-llama/llama-3-8b-instruct \
-o max_new_tokens 1000 \
-s "You are an assistant for a CLI (command line interface). Provide and help give unix commands to help users achieve their tasks."See all available models:
llm watsonx list-embedding-modelscat README.md | llm embed -m watsonx/ibm/slate-30m-english-rtrvr
