llm-palm

Plugin for LLM adding support for Google's PaLM 2 model


License
Apache-2.0
Install
pip install llm-palm==0.1

Documentation

llm-palm

PyPI Changelog Tests License

Plugin for LLM adding support for Google's PaLM 2 model.

Installation

Install this plugin in the same environment as LLM.

llm install llm-palm

Configuration

You will need an API key from Google. Instructions for obtaining one: https://developers.generativeai.google/tutorials/setup

You can set that as an environment variable called PALM_API_KEY, or add it to the llm set of saved keys using:

llm keys set palm
Enter key: <paste key here>

Usage

This plugin adds a model called palm. You can execute it like this:

llm -m palm "Ten great names for a pet pelican"

PaLM also supports system prompts:

echo "I like pelicans a lot" | llm -m palm --system "Translate to french"

Development

To set up this plugin locally, first checkout the code. Then create a new virtual environment:

cd llm-palm
python3 -m venv venv
source venv/bin/activate

Now install the dependencies and test dependencies:

pip install -e '.[test]'

To run the tests:

pytest