genius-chatbot

Use huggingface models to create an intelligent and scalable chatbot


Keywords
ai, chatbot, huggingface, models, python, transformers
License
MIT
Install
pip install genius-chatbot==1.2.0

Documentation

Genius Chatbot

PyPI - Version PyPI - Downloads GitHub Repo stars GitHub forks GitHub contributors PyPI - License GitHub

GitHub last commit (by committer) GitHub pull requests GitHub closed pull requests GitHub issues

GitHub top language GitHub language count GitHub repo size GitHub repo file count (file type) PyPI - Wheel PyPI - Implementation

Version: 1.10.4

Chatbot that uses any hugging face model or OpenAI endpoint.

Local vector store supported with ChromaDB, or connect to a PGVector database

Allows for scalable intelligence tailored for hardware limitations

This repository is actively maintained - Contributions are welcome!

Contribution Opportunities:

  • Support more vector databases
  • Get list of models to choose from
  • Output everything as JSON when selected
Usage:
Short Flag Long Flag Description
-h --help See Usage
-a --assimilate Assimilate knowledge from media provided in directory
--batch-token Number of tokens per batch
--chromadb-directory Number of chunks to use
--chunks Number of chunks to use
-e --embeddings-model Embeddings model to use
--hide-source Hide source of answer
-j --json Export to JSON
--openai-token OpenAI Token
--openai-api OpenAI API Url
--pgvector-user PGVector user
--pgvector-password PGVector password
--pgvector-host PGVector host
--pgvector-port PGVector port
--pgvector-database PGVector database
--pgvector-driver PGVector driver
-p --prompt Prompt for chatbot
--mute-stream Mute stream of generation
-m --model Copy GPT4All .bin file from the Model Explorer
--max-token-limit Maximum token to generate
--model-directory Directory to store models locally
--model-engine GPT4All LlamaCPP, or OpenAI
Example:
genius-chatbot --assimilate "/directory/of/documents"
genius-chatbot --prompt "What is the 10th digit of Pi?"
genius-chatbot --prompt "Chatbots are cool because they" \
    --model "wizardlm-13b-v1.1-superhot-8k.ggmlv3.q4_0.bin" \
    --model-engine "GPT4All" \
    --assimilate "/directory/of/documents" \
    --json
Installation Instructions:

Install Python Package

Windows Prerequisites:

Visual Studio Code 2022

winget install -e --id Kitware.CMake

Ubuntu Prerequisites:

apt install -y pandoc
python -m pip install genius-chatbot

Geniusbot Application

Use with a GUI through Geniusbot

Visit our GitHub for more information

Installation Instructions with Geniusbot:

Install Python Package

python -m pip install geniusbot
Repository Owners:

GitHub followers GitHub User's stars