Package org.apache.lucene.analysis.classic
Fast, general-purpose grammar-based tokenizers.
ClassicTokenizer
: this class was formerly
(prior to Lucene 3.1) named StandardTokenizer
. (Its tokenization rules are not based
on the Unicode Text Segmentation algorithm.) ClassicAnalyzer
includes ClassicTokenizer
, LowerCaseFilter
and StopFilter
.-
Class Summary Class Description ClassicAnalyzer FiltersClassicTokenizer
withClassicFilter
,LowerCaseFilter
andStopFilter
, using a list of English stop words.ClassicFilter Normalizes tokens extracted withClassicTokenizer
.ClassicFilterFactory Factory forClassicFilter
.ClassicTokenizer A grammar-based tokenizer constructed with JFlexClassicTokenizerFactory Factory forClassicTokenizer
.