text-normalizer

Yoctol Natural Language Text Normalizer


Keywords
natural-language-processing, preprocessing, pypi
License
MIT
Install
pip install text-normalizer==0.1.2

Documentation

text-normalizer

travis pypi

Normalize your Text String. It is a python package that help you normalize your text data and recover it.

Install

Use Python3

> pip install text-normalizer

Usage

from text_normalizer.text_normalizer_collection_library import chinese_charactor_text_normalizer_collection_2


input_sentence = "   我在85.33度C買了一杯900──1000元的咖啡    《ohoh》?? m_m"
nor_sentence, meta = chinese_charactor_text_normalizer_collection_2.normalize(input_sentence)
print(nor_sentence)
> "我在_float_度c買了一杯_int_-_int_元的咖啡 <ohoh>?? m_m"

de_sentence = chinese_charactor_text_normalizer_collection_2.denormalize(nor_sentence, meta)
print(de_sentence)
> "我在85.33度C買了一杯900──1000元的咖啡 《ohoh》?? m_m",