|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Object org.apache.lucene.analysis.Analyzer org.apache.lucene.analysis.nl.DutchAnalyzer
public class DutchAnalyzer
Analyzer
for Dutch language.
Supports an external list of stopwords (words that will not be indexed at all), an external list of exclusions (word that will not be stemmed, but indexed) and an external list of word-stem pairs that overrule the algorithm (dictionary stemming). A default set of stopwords is used unless an alternative list is specified, but the exclusion list is empty by default.
NOTE: This class uses the same Version
dependent settings as StandardAnalyzer
.
Field Summary | |
---|---|
static String[] |
DUTCH_STOP_WORDS
Deprecated. use getDefaultStopSet() instead |
Fields inherited from class org.apache.lucene.analysis.Analyzer |
---|
overridesTokenStreamMethod |
Constructor Summary | |
---|---|
DutchAnalyzer(org.apache.lucene.util.Version matchVersion)
Builds an analyzer with the default stop words ( DUTCH_STOP_WORDS )
and a few default entries for the stem exclusion table. |
|
DutchAnalyzer(org.apache.lucene.util.Version matchVersion,
File stopwords)
Deprecated. use DutchAnalyzer(Version, Set) instead |
|
DutchAnalyzer(org.apache.lucene.util.Version matchVersion,
HashSet<?> stopwords)
Deprecated. use DutchAnalyzer(Version, Set) instead |
|
DutchAnalyzer(org.apache.lucene.util.Version matchVersion,
Set<?> stopwords)
|
|
DutchAnalyzer(org.apache.lucene.util.Version matchVersion,
Set<?> stopwords,
Set<?> stemExclusionTable)
|
|
DutchAnalyzer(org.apache.lucene.util.Version matchVersion,
String... stopwords)
Deprecated. use DutchAnalyzer(Version, Set) instead |
Method Summary | |
---|---|
static Set<?> |
getDefaultStopSet()
Returns an unmodifiable instance of the default stop-words set. |
org.apache.lucene.analysis.TokenStream |
reusableTokenStream(String fieldName,
Reader reader)
Returns a (possibly reused) TokenStream which tokenizes all the
text in the provided Reader . |
void |
setStemDictionary(File stemdictFile)
Reads a stemdictionary file , that overrules the stemming algorithm This is a textfile that contains per line word\tstem, i.e: two tab seperated words |
void |
setStemExclusionTable(File exclusionlist)
Deprecated. use DutchAnalyzer(Version, Set, Set) instead |
void |
setStemExclusionTable(HashSet<?> exclusionlist)
Deprecated. use DutchAnalyzer(Version, Set, Set) instead |
void |
setStemExclusionTable(String... exclusionlist)
Deprecated. use DutchAnalyzer(Version, Set, Set) instead |
org.apache.lucene.analysis.TokenStream |
tokenStream(String fieldName,
Reader reader)
Creates a TokenStream which tokenizes all the text in the
provided Reader . |
Methods inherited from class org.apache.lucene.analysis.Analyzer |
---|
close, getOffsetGap, getPositionIncrementGap, getPreviousTokenStream, setOverridesTokenStreamMethod, setPreviousTokenStream |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Field Detail |
---|
public static final String[] DUTCH_STOP_WORDS
getDefaultStopSet()
instead
Constructor Detail |
---|
public DutchAnalyzer(org.apache.lucene.util.Version matchVersion)
DUTCH_STOP_WORDS
)
and a few default entries for the stem exclusion table.
public DutchAnalyzer(org.apache.lucene.util.Version matchVersion, Set<?> stopwords)
public DutchAnalyzer(org.apache.lucene.util.Version matchVersion, Set<?> stopwords, Set<?> stemExclusionTable)
public DutchAnalyzer(org.apache.lucene.util.Version matchVersion, String... stopwords)
DutchAnalyzer(Version, Set)
instead
matchVersion
- stopwords
- public DutchAnalyzer(org.apache.lucene.util.Version matchVersion, HashSet<?> stopwords)
DutchAnalyzer(Version, Set)
instead
stopwords
- public DutchAnalyzer(org.apache.lucene.util.Version matchVersion, File stopwords)
DutchAnalyzer(Version, Set)
instead
stopwords
- Method Detail |
---|
public static Set<?> getDefaultStopSet()
public void setStemExclusionTable(String... exclusionlist)
DutchAnalyzer(Version, Set, Set)
instead
exclusionlist
- public void setStemExclusionTable(HashSet<?> exclusionlist)
DutchAnalyzer(Version, Set, Set)
instead
public void setStemExclusionTable(File exclusionlist)
DutchAnalyzer(Version, Set, Set)
instead
public void setStemDictionary(File stemdictFile)
public org.apache.lucene.analysis.TokenStream tokenStream(String fieldName, Reader reader)
TokenStream
which tokenizes all the text in the
provided Reader
.
tokenStream
in class org.apache.lucene.analysis.Analyzer
TokenStream
built from a StandardTokenizer
filtered with StandardFilter
, StopFilter
,
and DutchStemFilter
public org.apache.lucene.analysis.TokenStream reusableTokenStream(String fieldName, Reader reader) throws IOException
TokenStream
which tokenizes all the
text in the provided Reader
.
reusableTokenStream
in class org.apache.lucene.analysis.Analyzer
TokenStream
built from a StandardTokenizer
filtered with StandardFilter
, StopFilter
,
and DutchStemFilter
IOException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |