org.apache.lucene.analysis.nl
Class DutchAnalyzer
public class DutchAnalyzer
Analyzer for Dutch language. Supports an external list of stopwords (words that
will not be indexed at all), an external list of exclusions (word that will
not be stemmed, but indexed) and an external list of word-stem pairs that overrule
the algorithm (dictionary stemming).
A default set of stopwords is used unless an alternative list is specified, the
exclusion list is empty by default.
DutchAnalyzer() - Builds an analyzer with the default stop words (
DUTCH_STOP_WORDS )
and a few default entries for the stem exclusion table.
|
DutchAnalyzer(File stopwords) - Builds an analyzer with the given stop words.
|
DutchAnalyzer(HashSet stopwords) - Builds an analyzer with the given stop words.
|
DutchAnalyzer(String[] stopwords) - Builds an analyzer with the given stop words.
|
void | setStemDictionary(File stemdictFile) - Reads a stemdictionary file , that overrules the stemming algorithm
This is a textfile that contains per line
word\tstem, i.e: two tab seperated words
|
void | setStemExclusionTable(File exclusionlist) - Builds an exclusionlist from the words contained in the given file.
|
void | setStemExclusionTable(HashSet exclusionlist) - Builds an exclusionlist from a Hashtable.
|
void | setStemExclusionTable(String[] exclusionlist) - Builds an exclusionlist from an array of Strings.
|
TokenStream | tokenStream(String fieldName, Reader reader) - Creates a TokenStream which tokenizes all the text in the provided TextReader.
|
DUTCH_STOP_WORDS
public static final String[] DUTCH_STOP_WORDS
List of typical Dutch stopwords.
DutchAnalyzer
public DutchAnalyzer()
Builds an analyzer with the default stop words (
DUTCH_STOP_WORDS
)
and a few default entries for the stem exclusion table.
DutchAnalyzer
public DutchAnalyzer(File stopwords)
Builds an analyzer with the given stop words.
DutchAnalyzer
public DutchAnalyzer(HashSet stopwords)
Builds an analyzer with the given stop words.
DutchAnalyzer
public DutchAnalyzer(String[] stopwords)
Builds an analyzer with the given stop words.
setStemDictionary
public void setStemDictionary(File stemdictFile)
Reads a stemdictionary file , that overrules the stemming algorithm
This is a textfile that contains per line
word\tstem, i.e: two tab seperated words
setStemExclusionTable
public void setStemExclusionTable(File exclusionlist)
Builds an exclusionlist from the words contained in the given file.
setStemExclusionTable
public void setStemExclusionTable(HashSet exclusionlist)
Builds an exclusionlist from a Hashtable.
setStemExclusionTable
public void setStemExclusionTable(String[] exclusionlist)
Builds an exclusionlist from an array of Strings.
tokenStream
public TokenStream tokenStream(String fieldName,
Reader reader)
Creates a TokenStream which tokenizes all the text in the provided TextReader.
- tokenStream in interface Analyzer
- A TokenStream build from a StandardTokenizer filtered with StandardFilter,
StopFilter, DutchStemFilter
Copyright © 2000-2007 Apache Software Foundation. All Rights Reserved.