tokenizers-collection

A simple iterator for using a set of Chinese tokenizer


Keywords
tokenizers_collection
License
MIT
Install
pip install tokenizers-collection==0.1.2