Package org.apache.lucene.analysis.miscellaneous

Miscellaneous TokenStreams


Class Summary
EmptyTokenStream An always exhausted token stream.
PatternAnalyzer Efficient Lucene analyzer/tokenizer that preferably operates on a String rather than a Reader, that can flexibly separate text into terms via a regular expression Pattern (with behaviour identical to String.split(String)), and that combines the functionality of LetterTokenizer, LowerCaseTokenizer, WhitespaceTokenizer, StopFilter into a single efficient multi-purpose class.
PrefixAndSuffixAwareTokenFilter Links two PrefixAwareTokenFilter.
PrefixAwareTokenFilter Joins two token streams and leaves the last token of the first stream available to be used when updating the token values in the second stream based on that token.
SingleTokenTokenStream A TokenStream containing a single token.

Package org.apache.lucene.analysis.miscellaneous Description

Miscellaneous TokenStreams

Copyright © 2000-2010 Apache Software Foundation. All Rights Reserved.