A forgiving code tokenizer for tokenizing most programming languages such as Javascript, TypeScript, Python, C, C++, PHP, Forth and so on. A nice basis for making a compiler or DSL.
Repository Packagist
Login to resync this project