allennlp-wordsplitter-ltp

LTP word splitter for AllenNLP


Keywords
allennlp, ltp, nlp
Install
pip install allennlp-wordsplitter-ltp==0.1a1

Documentation

allennlp_wordsplitter_ltpnlp

Add a LTP WordSplitter into AllenNLP's tokenizers.

config

{
  "dataset_reader": {

    // ... ...

    "tokenizer": {
      "word_splitter": {
        "type": "ltp_remote",
        "url": "http://10.1.1.174:12345/ltp"
      }
    },

    // ... ...

  },

  // ... ...

}

CLI

allennlp train --include-package allennlp_wordsplitter_ltp -s /your/output/dir /your/training/config/file