org.apache.lucene.analysis.cn
Class ChineseFilter

java.lang.Object
  org.apache.lucene.analysis.TokenStream
      org.apache.lucene.analysis.TokenFilter
          org.apache.lucene.analysis.cn.ChineseFilter

public final class ChineseFilter

extends TokenFilter

Title: ChineseFilter Description: Filter with a stop word table Rule: No digital is allowed. English word/token should larger than 1 character. One Chinese character as one Chinese word. TO DO: 1. Add Chinese stop words, such as  2. Dictionary based Chinese word extraction 3. Intelligent Chinese word extraction Copyright: Copyright (c) 2001 Company:

Version:

1.0

Author:

Yiyi Sun

Field Summary

static java.lang.String[]

STOP_WORDS

Fields inherited from class org.apache.lucene.analysis.TokenFilter

input

Constructor Summary

ChineseFilter(TokenStream in)

Method Summary

Token

next() Returns the next token in the stream, or null at EOS.

Methods inherited from class org.apache.lucene.analysis.TokenFilter

close

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

STOP_WORDS

public static final java.lang.String[] STOP_WORDS

Constructor Detail

ChineseFilter

public ChineseFilter(TokenStream in)

Method Detail

next

public final Token next()
                 throws java.io.IOException

Description copied from class: TokenStream

Returns the next token in the stream, or null at EOS.

Specified by:

next in class TokenStream

Throws:

java.io.IOException