|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.lucene.analysis.Analyzer org.apache.lucene.analysis.ReusableAnalyzerBase org.apache.lucene.analysis.nl.DutchAnalyzer
public final class DutchAnalyzer
Analyzer
for Dutch language.
Supports an external list of stopwords (words that will not be indexed at all), an external list of exclusions (word that will not be stemmed, but indexed) and an external list of word-stem pairs that overrule the algorithm (dictionary stemming). A default set of stopwords is used unless an alternative list is specified, but the exclusion list is empty by default.
You must specify the required Version
compatibility when creating DutchAnalyzer:
NOTE: This class uses the same Version
dependent settings as StandardAnalyzer
.
Nested Class Summary |
---|
Nested classes/interfaces inherited from class org.apache.lucene.analysis.ReusableAnalyzerBase |
---|
ReusableAnalyzerBase.TokenStreamComponents |
Field Summary | |
---|---|
static String |
DEFAULT_STOPWORD_FILE
File containing default Dutch stopwords. |
static String[] |
DUTCH_STOP_WORDS
Deprecated. use getDefaultStopSet() instead |
Constructor Summary | |
---|---|
DutchAnalyzer(Version matchVersion)
Builds an analyzer with the default stop words ( getDefaultStopSet() )
and a few default entries for the stem exclusion table. |
|
DutchAnalyzer(Version matchVersion,
File stopwords)
Deprecated. use DutchAnalyzer(Version, Set) instead |
|
DutchAnalyzer(Version matchVersion,
HashSet<?> stopwords)
Deprecated. use DutchAnalyzer(Version, Set) instead |
|
DutchAnalyzer(Version matchVersion,
Set<?> stopwords)
|
|
DutchAnalyzer(Version matchVersion,
Set<?> stopwords,
Set<?> stemExclusionTable)
|
|
DutchAnalyzer(Version matchVersion,
String... stopwords)
Deprecated. use DutchAnalyzer(Version, Set) instead |
Method Summary | |
---|---|
protected ReusableAnalyzerBase.TokenStreamComponents |
createComponents(String fieldName,
Reader aReader)
Returns a (possibly reused) TokenStream which tokenizes all the
text in the provided Reader . |
static Set<?> |
getDefaultStopSet()
Returns an unmodifiable instance of the default stop-words set. |
void |
setStemDictionary(File stemdictFile)
Deprecated. This prevents reuse of TokenStreams. If you wish to use a custom stem dictionary, create your own Analyzer with StemmerOverrideFilter |
void |
setStemExclusionTable(File exclusionlist)
Deprecated. use DutchAnalyzer(Version, Set, Set) instead |
void |
setStemExclusionTable(HashSet<?> exclusionlist)
Deprecated. use DutchAnalyzer(Version, Set, Set) instead |
void |
setStemExclusionTable(String... exclusionlist)
Deprecated. use DutchAnalyzer(Version, Set, Set) instead |
Methods inherited from class org.apache.lucene.analysis.ReusableAnalyzerBase |
---|
initReader, reusableTokenStream, tokenStream |
Methods inherited from class org.apache.lucene.analysis.Analyzer |
---|
close, getOffsetGap, getPositionIncrementGap, getPreviousTokenStream, setPreviousTokenStream |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
@Deprecated public static final String[] DUTCH_STOP_WORDS
getDefaultStopSet()
instead
public static final String DEFAULT_STOPWORD_FILE
Constructor Detail |
---|
public DutchAnalyzer(Version matchVersion)
getDefaultStopSet()
)
and a few default entries for the stem exclusion table.
public DutchAnalyzer(Version matchVersion, Set<?> stopwords)
public DutchAnalyzer(Version matchVersion, Set<?> stopwords, Set<?> stemExclusionTable)
@Deprecated public DutchAnalyzer(Version matchVersion, String... stopwords)
DutchAnalyzer(Version, Set)
instead
matchVersion
- stopwords
- @Deprecated public DutchAnalyzer(Version matchVersion, HashSet<?> stopwords)
DutchAnalyzer(Version, Set)
instead
stopwords
- @Deprecated public DutchAnalyzer(Version matchVersion, File stopwords)
DutchAnalyzer(Version, Set)
instead
stopwords
- Method Detail |
---|
public static Set<?> getDefaultStopSet()
@Deprecated public void setStemExclusionTable(String... exclusionlist)
DutchAnalyzer(Version, Set, Set)
instead
exclusionlist
- @Deprecated public void setStemExclusionTable(HashSet<?> exclusionlist)
DutchAnalyzer(Version, Set, Set)
instead
@Deprecated public void setStemExclusionTable(File exclusionlist)
DutchAnalyzer(Version, Set, Set)
instead
@Deprecated public void setStemDictionary(File stemdictFile)
StemmerOverrideFilter
protected ReusableAnalyzerBase.TokenStreamComponents createComponents(String fieldName, Reader aReader)
TokenStream
which tokenizes all the
text in the provided Reader
.
createComponents
in class ReusableAnalyzerBase
fieldName
- the name of the fields content passed to the
ReusableAnalyzerBase.TokenStreamComponents
sink as a readeraReader
- the reader passed to the Tokenizer
constructor
TokenStream
built from a StandardTokenizer
filtered with StandardFilter
, LowerCaseFilter
,
StopFilter
, KeywordMarkerFilter
if a stem exclusion set is provided,
StemmerOverrideFilter
, and SnowballFilter
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |