public final class BrazilianAnalyzer extends StopwordAnalyzerBase
Analyzer
for Brazilian Portuguese language.
Supports an external list of stopwords (words that will not be indexed at all) and an external list of exclusions (words that will not be stemmed, but indexed).
NOTE: This class uses the same Version
dependent settings as StandardAnalyzer
.
ReusableAnalyzerBase.TokenStreamComponents
Modifier and Type | Field and Description |
---|---|
static String[] |
BRAZILIAN_STOP_WORDS
Deprecated.
use
getDefaultStopSet() instead |
static String |
DEFAULT_STOPWORD_FILE
File containing default Brazilian Portuguese stopwords.
|
matchVersion, stopwords
Constructor and Description |
---|
BrazilianAnalyzer(Version matchVersion)
Builds an analyzer with the default stop words (
getDefaultStopSet() ). |
BrazilianAnalyzer(Version matchVersion,
File stopwords)
Deprecated.
use
BrazilianAnalyzer(Version, Set) instead |
BrazilianAnalyzer(Version matchVersion,
Map<?,?> stopwords)
Deprecated.
use
BrazilianAnalyzer(Version, Set) instead |
BrazilianAnalyzer(Version matchVersion,
Set<?> stopwords)
Builds an analyzer with the given stop words
|
BrazilianAnalyzer(Version matchVersion,
Set<?> stopwords,
Set<?> stemExclusionSet)
Builds an analyzer with the given stop words and stemming exclusion words
|
BrazilianAnalyzer(Version matchVersion,
String... stopwords)
Deprecated.
use
BrazilianAnalyzer(Version, Set) instead |
Modifier and Type | Method and Description |
---|---|
protected ReusableAnalyzerBase.TokenStreamComponents |
createComponents(String fieldName,
Reader reader)
Creates
ReusableAnalyzerBase.TokenStreamComponents
used to tokenize all the text in the provided Reader . |
static Set<?> |
getDefaultStopSet()
Returns an unmodifiable instance of the default stop-words set.
|
void |
setStemExclusionTable(File exclusionlist)
Deprecated.
use
BrazilianAnalyzer(Version, Set, Set) instead |
void |
setStemExclusionTable(Map<?,?> exclusionlist)
Deprecated.
use
BrazilianAnalyzer(Version, Set, Set) instead |
void |
setStemExclusionTable(String... exclusionlist)
Deprecated.
use
BrazilianAnalyzer(Version, Set, Set) instead |
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet
initReader, reusableTokenStream, tokenStream
close, getOffsetGap, getPositionIncrementGap, getPreviousTokenStream, setPreviousTokenStream
@Deprecated public static final String[] BRAZILIAN_STOP_WORDS
getDefaultStopSet()
insteadpublic static final String DEFAULT_STOPWORD_FILE
public BrazilianAnalyzer(Version matchVersion)
getDefaultStopSet()
).public BrazilianAnalyzer(Version matchVersion, Set<?> stopwords)
matchVersion
- lucene compatibility versionstopwords
- a stopword setpublic BrazilianAnalyzer(Version matchVersion, Set<?> stopwords, Set<?> stemExclusionSet)
matchVersion
- lucene compatibility versionstopwords
- a stopword set@Deprecated public BrazilianAnalyzer(Version matchVersion, String... stopwords)
BrazilianAnalyzer(Version, Set)
instead@Deprecated public BrazilianAnalyzer(Version matchVersion, Map<?,?> stopwords)
BrazilianAnalyzer(Version, Set)
instead@Deprecated public BrazilianAnalyzer(Version matchVersion, File stopwords) throws IOException
BrazilianAnalyzer(Version, Set)
insteadIOException
public static Set<?> getDefaultStopSet()
@Deprecated public void setStemExclusionTable(String... exclusionlist)
BrazilianAnalyzer(Version, Set, Set)
instead@Deprecated public void setStemExclusionTable(Map<?,?> exclusionlist)
BrazilianAnalyzer(Version, Set, Set)
insteadMap
.@Deprecated public void setStemExclusionTable(File exclusionlist) throws IOException
BrazilianAnalyzer(Version, Set, Set)
insteadIOException
protected ReusableAnalyzerBase.TokenStreamComponents createComponents(String fieldName, Reader reader)
ReusableAnalyzerBase.TokenStreamComponents
used to tokenize all the text in the provided Reader
.createComponents
in class ReusableAnalyzerBase
fieldName
- the name of the fields content passed to the
ReusableAnalyzerBase.TokenStreamComponents
sink as a readerreader
- the reader passed to the Tokenizer
constructorReusableAnalyzerBase.TokenStreamComponents
built from a StandardTokenizer
filtered with
LowerCaseFilter
, StandardFilter
, StopFilter
, and BrazilianStemFilter
.