π Support us! If you find HandyLLM useful, please consider starring it to help it spread and improve π
A handy toolkit for using LLM, with both development support and VSCode editor support.
π Handy Prompt: self-containing prompt in a human-friendly mark-up format .hprompt
.
- Easy write: mark-up format, placeholder variables, request arguments, output logs... And most importantly VSCode syntax highlight!
- Easy run: both CLI and APIs available for parsing and running; run it with the CLI tool WITHOUT any code!
-
Easy chain: You can chain
hprompt
files to construct dynamic logic.
Other features:
β―οΈ Unified API design with both sync and async support
π‘ OpenAI and Azure APIs all in one
βοΈ Easy life with API endpoint management
pip3 install handyllm
or, install from the Github repo to get latest updates:
pip3 install git+https://github.com/atomiechen/handyllm.git
Please check HandyLLM VSCode extension for editor support.
Please check out our wiki for comprehensive guides ^_^
HandyLLM Β© 2024 by Atomie CHEN is licensed under the MIT License - see the LICENSE file for details.