public final class RussianAnalyzer extends StopwordAnalyzerBase
Analyzer
for Russian language.
Supports an external list of stopwords (words that will not be indexed at all). A default set of stopwords is used unless an alternative list is specified.
You must specify the required Version
compatibility when creating RussianAnalyzer:
Analyzer.GlobalReuseStrategy, Analyzer.PerFieldReuseStrategy, Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents
Modifier and Type | Field and Description |
---|---|
static String |
DEFAULT_STOPWORD_FILE
File containing default Russian stopwords.
|
matchVersion, stopwords
GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY
Constructor and Description |
---|
RussianAnalyzer(Version matchVersion) |
RussianAnalyzer(Version matchVersion,
CharArraySet stopwords)
Builds an analyzer with the given stop words
|
RussianAnalyzer(Version matchVersion,
CharArraySet stopwords,
CharArraySet stemExclusionSet)
Builds an analyzer with the given stop words
|
Modifier and Type | Method and Description |
---|---|
protected Analyzer.TokenStreamComponents |
createComponents(String fieldName,
Reader reader)
Creates
Analyzer.TokenStreamComponents
used to tokenize all the text in the provided Reader . |
static CharArraySet |
getDefaultStopSet()
Returns an unmodifiable instance of the default stop-words set.
|
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet
close, getOffsetGap, getPositionIncrementGap, getReuseStrategy, initReader, tokenStream, tokenStream
public static final String DEFAULT_STOPWORD_FILE
public RussianAnalyzer(Version matchVersion)
public RussianAnalyzer(Version matchVersion, CharArraySet stopwords)
matchVersion
- lucene compatibility versionstopwords
- a stopword setpublic RussianAnalyzer(Version matchVersion, CharArraySet stopwords, CharArraySet stemExclusionSet)
matchVersion
- lucene compatibility versionstopwords
- a stopword setstemExclusionSet
- a set of words not to be stemmedpublic static CharArraySet getDefaultStopSet()
protected Analyzer.TokenStreamComponents createComponents(String fieldName, Reader reader)
Analyzer.TokenStreamComponents
used to tokenize all the text in the provided Reader
.createComponents
in class Analyzer
Analyzer.TokenStreamComponents
built from a StandardTokenizer
filtered with
StandardFilter
, LowerCaseFilter
, StopFilter
, SetKeywordMarkerFilter
if a stem exclusion set is
provided, and SnowballFilter
Copyright © 2000-2014 Apache Software Foundation. All Rights Reserved.