Class | Description |
---|---|
EmptyTokenStream |
An always exhausted token stream.
|
PatternAnalyzer |
Efficient Lucene analyzer/tokenizer that preferably operates on a String rather than a
Reader , that can flexibly separate text into terms via a regular expression Pattern
(with behaviour identical to String.split(String) ),
and that combines the functionality of
LetterTokenizer ,
LowerCaseTokenizer ,
WhitespaceTokenizer ,
StopFilter into a single efficient
multi-purpose class. |
PrefixAndSuffixAwareTokenFilter |
Links two
PrefixAwareTokenFilter . |
PrefixAwareTokenFilter |
Joins two token streams and leaves the last token of the first stream available
to be used when updating the token values in the second stream based on that token.
|
SingleTokenTokenStream |
A
TokenStream containing a single token. |
StemmerOverrideFilter |
Provides the ability to override any
KeywordAttribute aware stemmer
with custom dictionary-based stemming. |