public final class BrazilianAnalyzer extends StopwordAnalyzerBase
Analyzer for Brazilian Portuguese language.
Supports an external list of stopwords (words that will not be indexed at all) and an external list of exclusions (words that will not be stemmed, but indexed).
NOTE: This class uses the same Version
dependent settings as StandardAnalyzer.
Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents| Modifier and Type | Field and Description |
|---|---|
static String |
DEFAULT_STOPWORD_FILE
File containing default Brazilian Portuguese stopwords.
|
stopwordsGLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY| Constructor and Description |
|---|
BrazilianAnalyzer()
Builds an analyzer with the default stop words (
getDefaultStopSet()). |
BrazilianAnalyzer(CharArraySet stopwords)
Builds an analyzer with the given stop words
|
BrazilianAnalyzer(CharArraySet stopwords,
CharArraySet stemExclusionSet)
Builds an analyzer with the given stop words and stemming exclusion words
|
| Modifier and Type | Method and Description |
|---|---|
protected Analyzer.TokenStreamComponents |
createComponents(String fieldName)
Creates
Analyzer.TokenStreamComponents
used to tokenize all the text in the provided Reader. |
static CharArraySet |
getDefaultStopSet()
Returns an unmodifiable instance of the default stop-words set.
|
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSetclose, getOffsetGap, getPositionIncrementGap, getReuseStrategy, getVersion, initReader, setVersion, tokenStream, tokenStreampublic static final String DEFAULT_STOPWORD_FILE
public BrazilianAnalyzer()
getDefaultStopSet()).public BrazilianAnalyzer(CharArraySet stopwords)
stopwords - a stopword setpublic BrazilianAnalyzer(CharArraySet stopwords, CharArraySet stemExclusionSet)
stopwords - a stopword setpublic static CharArraySet getDefaultStopSet()
protected Analyzer.TokenStreamComponents createComponents(String fieldName)
Analyzer.TokenStreamComponents
used to tokenize all the text in the provided Reader.createComponents in class AnalyzerAnalyzer.TokenStreamComponents
built from a StandardTokenizer filtered with
LowerCaseFilter, StandardFilter, StopFilter
, and BrazilianStemFilter.Copyright © 2000-2016 Apache Software Foundation. All Rights Reserved.