public final class ThaiAnalyzer extends StopwordAnalyzerBase
Analyzer
for Thai language. It uses BreakIterator
to break words.
You must specify the required Version
compatibility when creating ThaiAnalyzer:
Analyzer.GlobalReuseStrategy, Analyzer.PerFieldReuseStrategy, Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents
Modifier and Type | Field and Description |
---|---|
static String |
DEFAULT_STOPWORD_FILE
File containing default Thai stopwords.
|
stopwords
GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY
Constructor and Description |
---|
ThaiAnalyzer()
Builds an analyzer with the default stop words.
|
ThaiAnalyzer(CharArraySet stopwords)
Builds an analyzer with the given stop words.
|
ThaiAnalyzer(Version matchVersion)
Deprecated.
Use
ThaiAnalyzer() |
ThaiAnalyzer(Version matchVersion,
CharArraySet stopwords)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
protected Analyzer.TokenStreamComponents |
createComponents(String fieldName,
Reader reader)
Creates
Analyzer.TokenStreamComponents
used to tokenize all the text in the provided Reader . |
static CharArraySet |
getDefaultStopSet()
Returns an unmodifiable instance of the default stop words set.
|
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet
close, getOffsetGap, getPositionIncrementGap, getReuseStrategy, getVersion, initReader, setVersion, tokenStream, tokenStream
public static final String DEFAULT_STOPWORD_FILE
public ThaiAnalyzer()
@Deprecated public ThaiAnalyzer(Version matchVersion)
ThaiAnalyzer()
public ThaiAnalyzer(CharArraySet stopwords)
stopwords
- a stopword set@Deprecated public ThaiAnalyzer(Version matchVersion, CharArraySet stopwords)
ThaiAnalyzer(CharArraySet)
public static CharArraySet getDefaultStopSet()
protected Analyzer.TokenStreamComponents createComponents(String fieldName, Reader reader)
Analyzer.TokenStreamComponents
used to tokenize all the text in the provided Reader
.createComponents
in class Analyzer
Analyzer.TokenStreamComponents
built from a StandardTokenizer
filtered with
StandardFilter
, LowerCaseFilter
, ThaiWordFilter
, and
StopFilter
Copyright © 2000-2014 Apache Software Foundation. All Rights Reserved.