Version: 1.10.4
Chatbot that uses any hugging face model or OpenAI endpoint.
Local vector store supported with ChromaDB, or connect to a PGVector database
Allows for scalable intelligence tailored for hardware limitations
This repository is actively maintained - Contributions are welcome!
Contribution Opportunities:
- Support more vector databases
- Get list of models to choose from
- Output everything as JSON when selected
Usage:
| Short Flag | Long Flag | Description |
|---|---|---|
| -h | --help | See Usage |
| -a | --assimilate | Assimilate knowledge from media provided in directory |
| --batch-token | Number of tokens per batch | |
| --chromadb-directory | Number of chunks to use | |
| --chunks | Number of chunks to use | |
| -e | --embeddings-model | Embeddings model to use |
| --hide-source | Hide source of answer | |
| -j | --json | Export to JSON |
| --openai-token | OpenAI Token | |
| --openai-api | OpenAI API Url | |
| --pgvector-user | PGVector user | |
| --pgvector-password | PGVector password | |
| --pgvector-host | PGVector host | |
| --pgvector-port | PGVector port | |
| --pgvector-database | PGVector database | |
| --pgvector-driver | PGVector driver | |
| -p | --prompt | Prompt for chatbot |
| --mute-stream | Mute stream of generation | |
| -m | --model | Copy GPT4All .bin file from the Model Explorer |
| --max-token-limit | Maximum token to generate | |
| --model-directory | Directory to store models locally | |
| --model-engine | GPT4All LlamaCPP, or OpenAI |
Example:
genius-chatbot --assimilate "/directory/of/documents"genius-chatbot --prompt "What is the 10th digit of Pi?"genius-chatbot --prompt "Chatbots are cool because they" \
--model "wizardlm-13b-v1.1-superhot-8k.ggmlv3.q4_0.bin" \
--model-engine "GPT4All" \
--assimilate "/directory/of/documents" \
--jsonInstallation Instructions:
Install Python Package
Windows Prerequisites:
Visual Studio Code 2022
winget install -e --id Kitware.CMakeUbuntu Prerequisites:
apt install -y pandocpython -m pip install genius-chatbotUse with a GUI through Geniusbot
Visit our GitHub for more information
Installation Instructions with Geniusbot:
Install Python Package
python -m pip install geniusbotRepository Owners:
