org.apache.lucene.analysis.cn

Class ChineseFilter

java.lang.Object

org.apache.lucene.analysis.TokenStream

org.apache.lucene.analysis.TokenFilter

org.apache.lucene.analysis.cn.ChineseFilter

public final class ChineseFilter
extends TokenFilter

Title: ChineseFilter Description: Filter with a stop word table Rule: No digital is allowed. English word/token should larger than 1 character. One Chinese character as one Chinese word. TO DO: 1. Add Chinese stop words, such as  2. Dictionary based Chinese word extraction 3. Intelligent Chinese word extraction Copyright: Copyright (c) 2001 Company:

Version:

1.0

Author:

Yiyi Sun

Field Summary

Fields

Modifier and Type	Field and Description
static String[]	STOP_WORDS

Fields inherited from class org.apache.lucene.analysis.TokenFilter

input

Constructor Summary

Constructors

Constructor and Description
ChineseFilter(TokenStream in)

Method Summary

Methods

Modifier and Type	Method and Description
Token	next() Returns the next token in the stream, or null at EOS.

Methods inherited from class org.apache.lucene.analysis.TokenFilter

close

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

STOP_WORDS

public static final String[] STOP_WORDS

Constructor Detail

ChineseFilter

public ChineseFilter(TokenStream in)

Method Detail

next

public final Token next()
                 throws IOException

Description copied from class: TokenStream

Returns the next token in the stream, or null at EOS.

Specified by:

next in class TokenStream

Throws:

IOException