public final class EnglishAnalyzer extends StopwordAnalyzerBase
Analyzer
for English.Analyzer.GlobalReuseStrategy, Analyzer.PerFieldReuseStrategy, Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents
stopwords
GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY
Constructor and Description |
---|
EnglishAnalyzer()
Builds an analyzer with the default stop words:
getDefaultStopSet() . |
EnglishAnalyzer(CharArraySet stopwords)
Builds an analyzer with the given stop words.
|
EnglishAnalyzer(CharArraySet stopwords,
CharArraySet stemExclusionSet)
Builds an analyzer with the given stop words.
|
EnglishAnalyzer(Version matchVersion)
Deprecated.
|
EnglishAnalyzer(Version matchVersion,
CharArraySet stopwords)
Deprecated.
|
EnglishAnalyzer(Version matchVersion,
CharArraySet stopwords,
CharArraySet stemExclusionSet)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
protected Analyzer.TokenStreamComponents |
createComponents(String fieldName,
Reader reader)
Creates a
Analyzer.TokenStreamComponents
which tokenizes all the text in the provided Reader . |
static CharArraySet |
getDefaultStopSet()
Returns an unmodifiable instance of the default stop words set.
|
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet
close, getOffsetGap, getPositionIncrementGap, getReuseStrategy, getVersion, initReader, setVersion, tokenStream, tokenStream
public EnglishAnalyzer()
getDefaultStopSet()
.@Deprecated public EnglishAnalyzer(Version matchVersion)
EnglishAnalyzer()
public EnglishAnalyzer(CharArraySet stopwords)
stopwords
- a stopword set@Deprecated public EnglishAnalyzer(Version matchVersion, CharArraySet stopwords)
EnglishAnalyzer(CharArraySet)
public EnglishAnalyzer(CharArraySet stopwords, CharArraySet stemExclusionSet)
SetKeywordMarkerFilter
before
stemming.stopwords
- a stopword setstemExclusionSet
- a set of terms not to be stemmed@Deprecated public EnglishAnalyzer(Version matchVersion, CharArraySet stopwords, CharArraySet stemExclusionSet)
EnglishAnalyzer(CharArraySet,CharArraySet)
public static CharArraySet getDefaultStopSet()
protected Analyzer.TokenStreamComponents createComponents(String fieldName, Reader reader)
Analyzer.TokenStreamComponents
which tokenizes all the text in the provided Reader
.createComponents
in class Analyzer
Analyzer.TokenStreamComponents
built from an StandardTokenizer
filtered with
StandardFilter
, EnglishPossessiveFilter
,
LowerCaseFilter
, StopFilter
, SetKeywordMarkerFilter
if a stem exclusion set is
provided and PorterStemFilter
.Copyright © 2000-2014 Apache Software Foundation. All Rights Reserved.