Uses of Package
org.apache.lucene.analysis.tokenattributes
-
Packages that use org.apache.lucene.analysis.tokenattributes Package Description org.apache.lucene.analysis.standard Fast, general-purpose grammar-based tokenizerStandardTokenizer
implements the Word Break rules from the Unicode Text Segmentation algorithm, as specified in Unicode Standard Annex #29.org.apache.lucene.analysis.tokenattributes General-purpose attributes for text analysis. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.standard Class Description CharTermAttribute The term text of a Token. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.tokenattributes Class Description BytesTermAttribute This attribute can be used if you have the raw term bytes to be indexed.CharTermAttribute The term text of a Token.CharTermAttributeImpl Default implementation ofCharTermAttribute
.FlagsAttribute This attribute can be used to pass different flags down theTokenizer
chain, e.g.KeywordAttribute This attribute can be used to mark a token as a keyword.OffsetAttribute The start and end character offset of a Token.PackedTokenAttributeImpl Default implementation of the common attributes used by Lucene:CharTermAttribute
TypeAttribute
PositionIncrementAttribute
PositionLengthAttribute
OffsetAttribute
TermFrequencyAttribute
PayloadAttribute The payload of a Token.PayloadAttributeImpl Default implementation ofPayloadAttribute
.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.PositionLengthAttribute Determines how many positions this token spans.TermFrequencyAttribute Sets the custom term frequency of a term within one document.TermToBytesRefAttribute This attribute is requested by TermsHashPerField to index the contents.TypeAttribute A Token's lexical type.