Potato Distillery π₯ β‘ π₯
The purpose of this package is to make easier for users to create smaller versions of popular ML models, in order to fine-tune distilled versions of them.
Requirements:
- Huggingface
π€ - Transformers
π€ - Pytorch
π₯
Current support:
- BERT (Pytorch)
- GPT-2 (Pytorch)
- GPT-Neo (Pytorch)
