public final class IndonesianAnalyzer extends StopwordAnalyzerBase
Analyzer.GlobalReuseStrategy, Analyzer.PerFieldReuseStrategy, Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents
Modifier and Type | Field and Description |
---|---|
static String |
DEFAULT_STOPWORD_FILE
File containing default Indonesian stopwords.
|
matchVersion, stopwords
Constructor and Description |
---|
IndonesianAnalyzer(Version matchVersion)
Builds an analyzer with the default stop words:
DEFAULT_STOPWORD_FILE . |
IndonesianAnalyzer(Version matchVersion,
CharArraySet stopwords)
Builds an analyzer with the given stop words
|
IndonesianAnalyzer(Version matchVersion,
CharArraySet stopwords,
CharArraySet stemExclusionSet)
Builds an analyzer with the given stop word.
|
Modifier and Type | Method and Description |
---|---|
protected Analyzer.TokenStreamComponents |
createComponents(String fieldName,
Reader reader)
Creates
Analyzer.TokenStreamComponents
used to tokenize all the text in the provided Reader . |
static CharArraySet |
getDefaultStopSet()
Returns an unmodifiable instance of the default stop-words set.
|
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet
close, getOffsetGap, getPositionIncrementGap, initReader, tokenStream
public static final String DEFAULT_STOPWORD_FILE
public IndonesianAnalyzer(Version matchVersion)
DEFAULT_STOPWORD_FILE
.public IndonesianAnalyzer(Version matchVersion, CharArraySet stopwords)
matchVersion
- lucene compatibility versionstopwords
- a stopword setpublic IndonesianAnalyzer(Version matchVersion, CharArraySet stopwords, CharArraySet stemExclusionSet)
SetKeywordMarkerFilter
before
IndonesianStemFilter
.matchVersion
- lucene compatibility versionstopwords
- a stopword setstemExclusionSet
- a set of terms not to be stemmedpublic static CharArraySet getDefaultStopSet()
protected Analyzer.TokenStreamComponents createComponents(String fieldName, Reader reader)
Analyzer.TokenStreamComponents
used to tokenize all the text in the provided Reader
.createComponents
in class Analyzer
Analyzer.TokenStreamComponents
built from an StandardTokenizer
filtered with
StandardFilter
, LowerCaseFilter
,
StopFilter
, SetKeywordMarkerFilter
if a stem exclusion set is provided and IndonesianStemFilter
.Copyright © 2000-2013 Apache Software Foundation. All Rights Reserved.