|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.lucene.analysis.Analyzer org.apache.lucene.analysis.nl.DutchAnalyzer
public final class DutchAnalyzer
Analyzer
for Dutch language.
Supports an external list of stopwords (words that will not be indexed at all), an external list of exclusions (word that will not be stemmed, but indexed) and an external list of word-stem pairs that overrule the algorithm (dictionary stemming). A default set of stopwords is used unless an alternative list is specified, but the exclusion list is empty by default.
You must specify the required Version
compatibility when creating DutchAnalyzer:
DutchAnalyzer(Version, CharArraySet)
and
DutchAnalyzer(Version, CharArraySet, CharArraySet)
also populate
the default entries for the stem override dictionary
NOTE: This class uses the same Version
dependent settings as StandardAnalyzer
.
Nested Class Summary |
---|
Nested classes/interfaces inherited from class org.apache.lucene.analysis.Analyzer |
---|
Analyzer.GlobalReuseStrategy, Analyzer.PerFieldReuseStrategy, Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents |
Field Summary | |
---|---|
static String |
DEFAULT_STOPWORD_FILE
File containing default Dutch stopwords. |
Constructor Summary | |
---|---|
DutchAnalyzer(Version matchVersion)
Builds an analyzer with the default stop words ( getDefaultStopSet() )
and a few default entries for the stem exclusion table. |
|
DutchAnalyzer(Version matchVersion,
CharArraySet stopwords)
|
|
DutchAnalyzer(Version matchVersion,
CharArraySet stopwords,
CharArraySet stemExclusionTable)
|
|
DutchAnalyzer(Version matchVersion,
CharArraySet stopwords,
CharArraySet stemExclusionTable,
CharArrayMap<String> stemOverrideDict)
|
Method Summary | |
---|---|
protected Analyzer.TokenStreamComponents |
createComponents(String fieldName,
Reader aReader)
Returns a (possibly reused) TokenStream which tokenizes all the
text in the provided Reader . |
static CharArraySet |
getDefaultStopSet()
Returns an unmodifiable instance of the default stop-words set. |
Methods inherited from class org.apache.lucene.analysis.Analyzer |
---|
close, getOffsetGap, getPositionIncrementGap, initReader, tokenStream |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
public static final String DEFAULT_STOPWORD_FILE
Constructor Detail |
---|
public DutchAnalyzer(Version matchVersion)
getDefaultStopSet()
)
and a few default entries for the stem exclusion table.
public DutchAnalyzer(Version matchVersion, CharArraySet stopwords)
public DutchAnalyzer(Version matchVersion, CharArraySet stopwords, CharArraySet stemExclusionTable)
public DutchAnalyzer(Version matchVersion, CharArraySet stopwords, CharArraySet stemExclusionTable, CharArrayMap<String> stemOverrideDict)
Method Detail |
---|
public static CharArraySet getDefaultStopSet()
protected Analyzer.TokenStreamComponents createComponents(String fieldName, Reader aReader)
TokenStream
which tokenizes all the
text in the provided Reader
.
createComponents
in class Analyzer
TokenStream
built from a StandardTokenizer
filtered with StandardFilter
, LowerCaseFilter
,
StopFilter
, KeywordMarkerFilter
if a stem exclusion set is provided,
StemmerOverrideFilter
, and SnowballFilter
|
|||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | ||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |