TRANSFORMSTORM

About

This is a small interface built to play with small language models in the terminal.

I think language models are most interesting as a way of exploring common patterns in the parts of languge they are fine tuned on, but I am not a huge fan of sentence completion or conversation as a way of interacting with them. I fine tuned gpt2 on RPGs from the 200 Word RPG Challenge (https://200wordrpg.github.io/), and I wanted a new way of exploring the kind of language the model would generate, so I built a terminal interface to provide an interactive way to see what kinds of phrases, idioms, and patterns of speech the model would generate in an interactive environment, where the user can guide text generation, but can't prompt the model directly.

Installing and Running

To install run

pip install transformstorm

After installing, you can run

transformstorm

to download the 200wordrpg model and run. If you run transformstorm in a directory with a model subdirectory, it will attempt to load a pytorch model from that directory instead of pulling and loading the default model.

You can also run

transformstorm --name NAMEOFAMODELONHUGGINGFACE

to download any other huggingface CasualLM model and run the interface with it.