Class ClassicFilter
- java.lang.Object
-
- org.apache.lucene.util.AttributeSource
-
- org.apache.lucene.analysis.TokenStream
-
- org.apache.lucene.analysis.TokenFilter
-
- org.apache.lucene.analysis.classic.ClassicFilter
-
- All Implemented Interfaces:
java.io.Closeable
,java.lang.AutoCloseable
,Unwrappable<TokenStream>
public class ClassicFilter extends TokenFilter
Normalizes tokens extracted withClassicTokenizer
.
-
-
Nested Class Summary
-
Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource
AttributeSource.State
-
-
Field Summary
Fields Modifier and Type Field Description private static java.lang.String
ACRONYM_TYPE
private static java.lang.String
APOSTROPHE_TYPE
private CharTermAttribute
termAtt
private TypeAttribute
typeAtt
-
Fields inherited from class org.apache.lucene.analysis.TokenFilter
input
-
Fields inherited from class org.apache.lucene.analysis.TokenStream
DEFAULT_TOKEN_ATTRIBUTE_FACTORY
-
-
Constructor Summary
Constructors Constructor Description ClassicFilter(TokenStream in)
Construct filtering in.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description boolean
incrementToken()
Returns the next token in the stream, or null at EOS.-
Methods inherited from class org.apache.lucene.analysis.TokenFilter
close, end, reset, unwrap
-
Methods inherited from class org.apache.lucene.util.AttributeSource
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, endAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, removeAllAttributes, restoreState, toString
-
-
-
-
Field Detail
-
APOSTROPHE_TYPE
private static final java.lang.String APOSTROPHE_TYPE
-
ACRONYM_TYPE
private static final java.lang.String ACRONYM_TYPE
-
typeAtt
private final TypeAttribute typeAtt
-
termAtt
private final CharTermAttribute termAtt
-
-
Constructor Detail
-
ClassicFilter
public ClassicFilter(TokenStream in)
Construct filtering in.
-
-
Method Detail
-
incrementToken
public final boolean incrementToken() throws java.io.IOException
Returns the next token in the stream, or null at EOS.Removes
's
from the end of words.Removes dots from acronyms.
- Specified by:
incrementToken
in classTokenStream
- Returns:
- false for end of stream; true otherwise
- Throws:
java.io.IOException
-
-