Package org.apache.lucene.analysis.classic
package org.apache.lucene.analysis.classic
Fast, general-purpose grammar-based tokenizers.
ClassicTokenizer
: this class was formerly
(prior to Lucene 3.1) named StandardTokenizer
. (Its tokenization rules are not based
on the Unicode Text Segmentation algorithm.) ClassicAnalyzer
includes ClassicTokenizer
, LowerCaseFilter
and StopFilter
.-
ClassDescriptionFilters
ClassicTokenizer
withClassicFilter
,LowerCaseFilter
andStopFilter
, using a list of English stop words.Normalizes tokens extracted withClassicTokenizer
.Factory forClassicFilter
.A grammar-based tokenizer constructed with JFlexFactory forClassicTokenizer
.