gguf-selector

GGUF selector


Keywords
connector, gguf, llama, selector
License
MIT
Install
pip install gguf-selector==0.0.5

Documentation

GGUF selector

Static Badge

This package is a simple graphical user interface (GUI) application that uses the llama.cpp to interact with a chat model for generating responses.

include the module in your code

from gguf_selector import connector

You could pull any (pre-trained model) GGUF file(s) inside the folder and it will automatically be detected by the program.