Class FrenchCompoundAwareHunspellRule.NonSplittingTokenizer

java.lang.Object
org.languagetool.rules.fr.FrenchCompoundAwareHunspellRule.NonSplittingTokenizer
All Implemented Interfaces:
org.languagetool.tokenizers.CompoundWordTokenizer, org.languagetool.tokenizers.Tokenizer
Enclosing class:
FrenchCompoundAwareHunspellRule

static class FrenchCompoundAwareHunspellRule.NonSplittingTokenizer extends Object implements org.languagetool.tokenizers.CompoundWordTokenizer
  • Constructor Details

    • NonSplittingTokenizer

      NonSplittingTokenizer()
  • Method Details

    • tokenize

      public List<String> tokenize(String text)
      Specified by:
      tokenize in interface org.languagetool.tokenizers.Tokenizer