Package org.apache.lucene.analysis.pl
Class PolishAnalyzer
java.lang.Object
org.apache.lucene.analysis.Analyzer
org.apache.lucene.analysis.StopwordAnalyzerBase
org.apache.lucene.analysis.pl.PolishAnalyzer
- All Implemented Interfaces:
Closeable
,AutoCloseable
Analyzer
for Polish.- Since:
- 3.1
-
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.lucene.analysis.Analyzer
Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents
-
Field Summary
Modifier and TypeFieldDescriptionstatic final String
File containing default Polish stemmer table.static final String
File containing default Polish stopwords.Fields inherited from class org.apache.lucene.analysis.StopwordAnalyzerBase
stopwords
Fields inherited from class org.apache.lucene.analysis.Analyzer
GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY
-
Constructor Summary
ConstructorDescriptionBuilds an analyzer with the default stop words:DEFAULT_STOPWORD_FILE
.PolishAnalyzer
(CharArraySet stopwords) Builds an analyzer with the given stop words.PolishAnalyzer
(CharArraySet stopwords, CharArraySet stemExclusionSet) Builds an analyzer with the given stop words. -
Method Summary
Modifier and TypeMethodDescriptionprotected Analyzer.TokenStreamComponents
createComponents
(String fieldName) Creates aAnalyzer.TokenStreamComponents
which tokenizes all the text in the providedReader
.static CharArraySet
Returns an unmodifiable instance of the default stop words set.static Trie
Returns an unmodifiable instance of the default stemmer table.protected TokenStream
normalize
(String fieldName, TokenStream in) Methods inherited from class org.apache.lucene.analysis.StopwordAnalyzerBase
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet
Methods inherited from class org.apache.lucene.analysis.Analyzer
attributeFactory, close, getOffsetGap, getPositionIncrementGap, getReuseStrategy, initReader, initReaderForNormalization, normalize, tokenStream, tokenStream
-
Field Details
-
DEFAULT_STOPWORD_FILE
File containing default Polish stopwords.- See Also:
-
DEFAULT_STEMMER_FILE
File containing default Polish stemmer table.- See Also:
-
-
Constructor Details
-
PolishAnalyzer
public PolishAnalyzer()Builds an analyzer with the default stop words:DEFAULT_STOPWORD_FILE
. -
PolishAnalyzer
Builds an analyzer with the given stop words.- Parameters:
stopwords
- a stopword set
-
PolishAnalyzer
Builds an analyzer with the given stop words. If a non-empty stem exclusion set is provided this analyzer will add aSetKeywordMarkerFilter
before stemming.- Parameters:
stopwords
- a stopword setstemExclusionSet
- a set of terms not to be stemmed
-
-
Method Details
-
getDefaultStopSet
Returns an unmodifiable instance of the default stop words set.- Returns:
- default stop words set.
-
getDefaultTable
Returns an unmodifiable instance of the default stemmer table. -
createComponents
Creates aAnalyzer.TokenStreamComponents
which tokenizes all the text in the providedReader
.- Specified by:
createComponents
in classAnalyzer
- Returns:
- A
Analyzer.TokenStreamComponents
built from anStandardTokenizer
filtered withLowerCaseFilter
,StopFilter
,SetKeywordMarkerFilter
if a stem exclusion set is provided andStempelFilter
.
-
normalize
-