Package org.apache.lucene.analysis.uk
Class UkrainianMorfologikAnalyzer
- java.lang.Object
-
- org.apache.lucene.analysis.Analyzer
-
- org.apache.lucene.analysis.StopwordAnalyzerBase
-
- org.apache.lucene.analysis.uk.UkrainianMorfologikAnalyzer
-
- All Implemented Interfaces:
Closeable
,AutoCloseable
public final class UkrainianMorfologikAnalyzer extends StopwordAnalyzerBase
A dictionary-basedAnalyzer
for Ukrainian.- Since:
- 6.2.0
-
-
Nested Class Summary
-
Nested classes/interfaces inherited from class org.apache.lucene.analysis.Analyzer
Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents
-
-
Field Summary
Fields Modifier and Type Field Description static String
DEFAULT_STOPWORD_FILE
File containing default Ukrainian stopwords.-
Fields inherited from class org.apache.lucene.analysis.StopwordAnalyzerBase
stopwords
-
Fields inherited from class org.apache.lucene.analysis.Analyzer
GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY
-
-
Constructor Summary
Constructors Constructor Description UkrainianMorfologikAnalyzer()
Builds an analyzer with the default stop words:DEFAULT_STOPWORD_FILE
.UkrainianMorfologikAnalyzer(CharArraySet stopwords)
Builds an analyzer with the given stop words.UkrainianMorfologikAnalyzer(CharArraySet stopwords, CharArraySet stemExclusionSet)
Builds an analyzer with the given stop words.
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description protected Analyzer.TokenStreamComponents
createComponents(String fieldName)
Creates aAnalyzer.TokenStreamComponents
which tokenizes all the text in the providedReader
.static CharArraySet
getDefaultStopSet()
Returns an unmodifiable instance of the default stop words set.protected Reader
initReader(String fieldName, Reader reader)
-
Methods inherited from class org.apache.lucene.analysis.StopwordAnalyzerBase
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet
-
Methods inherited from class org.apache.lucene.analysis.Analyzer
attributeFactory, close, getOffsetGap, getPositionIncrementGap, getReuseStrategy, getVersion, initReaderForNormalization, normalize, normalize, setVersion, tokenStream, tokenStream
-
-
-
-
Field Detail
-
DEFAULT_STOPWORD_FILE
public static final String DEFAULT_STOPWORD_FILE
File containing default Ukrainian stopwords.- See Also:
- Constant Field Values
-
-
Constructor Detail
-
UkrainianMorfologikAnalyzer
public UkrainianMorfologikAnalyzer()
Builds an analyzer with the default stop words:DEFAULT_STOPWORD_FILE
.
-
UkrainianMorfologikAnalyzer
public UkrainianMorfologikAnalyzer(CharArraySet stopwords)
Builds an analyzer with the given stop words.- Parameters:
stopwords
- a stopword set
-
UkrainianMorfologikAnalyzer
public UkrainianMorfologikAnalyzer(CharArraySet stopwords, CharArraySet stemExclusionSet)
Builds an analyzer with the given stop words. If a non-empty stem exclusion set is provided this analyzer will add aSetKeywordMarkerFilter
before stemming.- Parameters:
stopwords
- a stopword setstemExclusionSet
- a set of terms not to be stemmed
-
-
Method Detail
-
getDefaultStopSet
public static CharArraySet getDefaultStopSet()
Returns an unmodifiable instance of the default stop words set.- Returns:
- default stop words set.
-
initReader
protected Reader initReader(String fieldName, Reader reader)
- Overrides:
initReader
in classAnalyzer
-
createComponents
protected Analyzer.TokenStreamComponents createComponents(String fieldName)
Creates aAnalyzer.TokenStreamComponents
which tokenizes all the text in the providedReader
.- Specified by:
createComponents
in classAnalyzer
- Returns:
- A
Analyzer.TokenStreamComponents
built from anStandardTokenizer
filtered withLowerCaseFilter
,StopFilter
,SetKeywordMarkerFilter
if a stem exclusion set is provided andMorfologikFilter
on the Ukrainian dictionary.
-
-