public final class StandardAnalyzer extends StopwordAnalyzerBase
StandardTokenizer
with StandardFilter
, LowerCaseFilter
and StopFilter
, using a list of
English stop words.
You must specify the required Version
compatibility when creating StandardAnalyzer:
ClassicTokenizer
and ClassicAnalyzer
are the pre-3.1 implementations of StandardTokenizer and
StandardAnalyzer.
Analyzer.GlobalReuseStrategy, Analyzer.PerFieldReuseStrategy, Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents
Modifier and Type | Field and Description |
---|---|
static int |
DEFAULT_MAX_TOKEN_LENGTH
Default maximum allowed token length
|
static CharArraySet |
STOP_WORDS_SET
An unmodifiable set containing some common English words that are usually not
useful for searching.
|
matchVersion, stopwords
GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY
Constructor and Description |
---|
StandardAnalyzer(Version matchVersion)
Builds an analyzer with the default stop words (
STOP_WORDS_SET ). |
StandardAnalyzer(Version matchVersion,
CharArraySet stopWords)
Builds an analyzer with the given stop words.
|
StandardAnalyzer(Version matchVersion,
Reader stopwords)
Builds an analyzer with the stop words from the given reader.
|
Modifier and Type | Method and Description |
---|---|
protected Analyzer.TokenStreamComponents |
createComponents(String fieldName,
Reader reader) |
int |
getMaxTokenLength() |
void |
setMaxTokenLength(int length)
Set maximum allowed token length.
|
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet
close, getOffsetGap, getPositionIncrementGap, getReuseStrategy, initReader, tokenStream, tokenStream
public static final int DEFAULT_MAX_TOKEN_LENGTH
public static final CharArraySet STOP_WORDS_SET
public StandardAnalyzer(Version matchVersion, CharArraySet stopWords)
matchVersion
- Lucene version to match See abovestopWords
- stop wordspublic StandardAnalyzer(Version matchVersion)
STOP_WORDS_SET
).matchVersion
- Lucene version to match See abovepublic StandardAnalyzer(Version matchVersion, Reader stopwords) throws IOException
matchVersion
- Lucene version to match See abovestopwords
- Reader to read stop words fromIOException
WordlistLoader.getWordSet(Reader, Version)
public void setMaxTokenLength(int length)
public int getMaxTokenLength()
setMaxTokenLength(int)
protected Analyzer.TokenStreamComponents createComponents(String fieldName, Reader reader)
createComponents
in class Analyzer
Copyright © 2000-2014 Apache Software Foundation. All Rights Reserved.