Class PersianWordTokenizer

java.lang.Object
org.languagetool.tokenizers.WordTokenizer
org.languagetool.tokenizers.PersianWordTokenizer
All Implemented Interfaces:
org.languagetool.tokenizers.Tokenizer

public class PersianWordTokenizer extends org.languagetool.tokenizers.WordTokenizer
Since:
2.7
  • Constructor Details

    • PersianWordTokenizer

      public PersianWordTokenizer()
  • Method Details

    • getTokenizingCharacters

      public String getTokenizingCharacters()
      Overrides:
      getTokenizingCharacters in class org.languagetool.tokenizers.WordTokenizer