分词工具, 把文件中的词分割成token
Homepage PyPI Python
pip install maketoken==0.0.2
分词工具 useages:
maketoken ./xxx.txt ./xxx.tokened.txt
The Tidelift Subscription provides access to a continuously curated stream of human-researched and maintainer-verified data on open source packages and their licenses, releases, vulnerabilities, and development practices.
See all contributors
Something wrong with this page? Make a suggestion
Export .ABOUT file for this package
Last synced: 2021-02-17 13:57:47 UTC
Login to resync this project