org.apache.lucene.analysis
public abstract class Tokenizer extends TokenStream
This is an abstract class.
Field Summary | |
---|---|
protected Reader | input The text source for this Tokenizer. |
Constructor Summary | |
---|---|
protected | Tokenizer() Construct a tokenizer with null input. |
protected | Tokenizer(Reader input) Construct a token stream processing the given input. |
Method Summary | |
---|---|
void | close() By default, closes the input Reader. |