Natural Language Toolkit for Indic Languages (iNLTK)
iNLTK aims to provide out of the box support for various NLP tasks that an application developer might need for Indic languages.
Documentation
Checkout detailed docs along with Installation instructions at https://inltk.readthedocs.io
Supported languages
| Language | Code |
|---|---|
| Hindi | hi |
| Punjabi | pa |
| Sanskrit | sa |
| Gujarati | gu |
| Kannada | kn |
| Malayalam | ml |
| Nepali | ne |
| Odia | or |
| Marathi | mr |
| Bengali | bn |
| Tamil | ta |
| Urdu | ur |
Repositories containing models used in iNLTK
Contributing
Add a new language support
If you would like to add support for language of your own choice to iNLTK, please start with checking/raising a issue here
Please checkout the steps I'd mentioned here for Telugu to begin with. They should be almost similar for other languages as well.
Improving models/using models for your own research
If you would like to take iNLTK's models and refine them with your own dataset or build your own custom models on top of it, please check out the repositories in the above table for the language of your choice. The repositories above contain links to datasets, pretrained models, classifiers and all of the code for that.
Add new functionality
If you wish for a particular functionality in iNLTK - Start by checking/raising a issue here
What's next
..and being worked upon
Shout out if you want to help :)
..and NOT being worked upon
Shout out if you want to lead :)
- Work on a unified model for all the languages
- POS support in iNLTK
- Add translations - to and from languages in iNLTK + English
iNLTK's Appreciation
- By Jeremy Howard on Twitter
- By Sebastian Ruder on Twitter
- By Vincent Boucher on LinkedIn
- By Kanimozhi, By Soham, By Imaad on LinkedIn
- iNLTK was trending on GitHub in May 2019
- iNLTK has had 23,000+ Downloads on PyPi
