Class SegToken
- java.lang.Object
-
- org.apache.lucene.analysis.cn.smart.hhmm.SegToken
-
public class SegToken extends java.lang.ObjectSmartChineseAnalyzer internal token
-
-
Field Summary
Fields Modifier and Type Field Description char[]charArrayCharacter array containing token textintendOffsetend offset into original sentenceintindexduring segmentation, this is used to store the index of the token in the token list tableintstartOffsetstart offset into original sentenceintweightword frequencyintwordTypeWordTypeof the text
-
Constructor Summary
Constructors Constructor Description SegToken(char[] idArray, int start, int end, int wordType, int weight)Create a new SegToken from a character array.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description booleanequals(java.lang.Object obj)inthashCode()
-
-
-
Field Detail
-
charArray
public char[] charArray
Character array containing token text
-
startOffset
public int startOffset
start offset into original sentence
-
endOffset
public int endOffset
end offset into original sentence
-
wordType
public int wordType
WordTypeof the text
-
weight
public int weight
word frequency
-
index
public int index
during segmentation, this is used to store the index of the token in the token list table
-
-
Constructor Detail
-
SegToken
public SegToken(char[] idArray, int start, int end, int wordType, int weight)Create a new SegToken from a character array.- Parameters:
idArray- character array containing textstart- start offset of SegToken in original sentenceend- end offset of SegToken in original sentencewordType-WordTypeof the textweight- word frequency
-
-