org.apache.lucene.analysis.cjk

Class CJKAnalyzer


public class CJKAnalyzer
extends Analyzer

Filters CJKTokenizer with StopFilter.
Author:
Che, Dong

Field Summary

static String[]
STOP_WORDS
An array containing some common English words that are not usually useful for searching and some double-byte interpunctions.

Constructor Summary

CJKAnalyzer()
Builds an analyzer which removes words in STOP_WORDS.
CJKAnalyzer(String[] stopWords)
Builds an analyzer which removes words in the provided array.

Method Summary

TokenStream
tokenStream(String fieldName, Reader reader)
get token stream from input

Methods inherited from class org.apache.lucene.analysis.Analyzer

getPositionIncrementGap, tokenStream

Field Details

STOP_WORDS

public static final String[] STOP_WORDS
An array containing some common English words that are not usually useful for searching and some double-byte interpunctions.

Constructor Details

CJKAnalyzer

public CJKAnalyzer()

CJKAnalyzer

public CJKAnalyzer(String[] stopWords)
Builds an analyzer which removes words in the provided array.
Parameters:
stopWords - stop word array

Method Details

tokenStream

public final TokenStream tokenStream(String fieldName,
                                     Reader reader)
get token stream from input
Overrides:
tokenStream in interface Analyzer
Parameters:
fieldName - lucene field name
reader - input reader
Returns:
TokenStream

Copyright © 2000-2007 Apache Software Foundation. All Rights Reserved.