Package org.languagetool.tokenizers
Class PersianWordTokenizer
java.lang.Object
org.languagetool.tokenizers.WordTokenizer
org.languagetool.tokenizers.PersianWordTokenizer
- All Implemented Interfaces:
org.languagetool.tokenizers.Tokenizer
public class PersianWordTokenizer
extends org.languagetool.tokenizers.WordTokenizer
- Since:
- 2.7
-
Constructor Summary
Constructors -
Method Summary
Methods inherited from class org.languagetool.tokenizers.WordTokenizer
getProtocols, isEMail, isUrl, joinEMails, joinEMailsAndUrls, joinUrls, tokenize
-
Constructor Details
-
PersianWordTokenizer
public PersianWordTokenizer()
-
-
Method Details
-
getTokenizingCharacters
- Overrides:
getTokenizingCharacters
in classorg.languagetool.tokenizers.WordTokenizer
-