NLP Models

A repository for building transformer based nlp models

Installation

Install from PyPi

pip install nlp-models

Install from source

git clone git@github.com:minggnim/nlp-models.git
pip install -r requirements

Llama2 Quantization model on consumer CPU

Run Chat applications on CPU

1. Streamlit UI

   cd apps
   streamlit run chat.py
   

2. Command line

   llm_app chat -s 'hi there'
   

Run Q&A application on CPU

1. Steamlit UI

   cd apps
   streamlit run qa.py
   

Models

1. bert_classifier A wrapper package around BERT-based classification models

   • Training example
   • Inference example

2. multi_task_model An implementation of multi-tasking model built on encoder models

   • Zero-shot multi-task model
   • Training example
   • Inference example
   • Qqrant Vector DB

3. GPT-2

   • Training GPT-2 model

4. Falcon 7B

   • Running Falcon 7b model

5. Quantized Llama2 models

   • Run Llama2 chat on CPU
   • Run Llama2 QA on a custom pdf document on CPU