@Deprecated public final class Lucene43NGramTokenizer extends Tokenizer
NGramTokenizer
.AttributeSource.State
Modifier and Type | Field and Description |
---|---|
static int |
DEFAULT_MAX_NGRAM_SIZE
Deprecated.
|
static int |
DEFAULT_MIN_NGRAM_SIZE
Deprecated.
|
DEFAULT_TOKEN_ATTRIBUTE_FACTORY
DEFAULT_ATTRIBUTE_FACTORY
Constructor and Description |
---|
Lucene43NGramTokenizer(AttributeFactory factory,
Reader input,
int minGram,
int maxGram)
Deprecated.
Creates NGramTokenizer with given min and max n-grams.
|
Lucene43NGramTokenizer(Reader input)
Deprecated.
Creates NGramTokenizer with default min and max n-grams.
|
Lucene43NGramTokenizer(Reader input,
int minGram,
int maxGram)
Deprecated.
Creates NGramTokenizer with given min and max n-grams.
|
Modifier and Type | Method and Description |
---|---|
void |
end()
Deprecated.
|
boolean |
incrementToken()
Deprecated.
Returns the next token in the stream, or null at EOS.
|
void |
reset()
Deprecated.
|
close, correctOffset, setReader
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toString
public static final int DEFAULT_MIN_NGRAM_SIZE
public static final int DEFAULT_MAX_NGRAM_SIZE
public Lucene43NGramTokenizer(Reader input, int minGram, int maxGram)
input
- Reader
holding the input to be tokenizedminGram
- the smallest n-gram to generatemaxGram
- the largest n-gram to generatepublic Lucene43NGramTokenizer(AttributeFactory factory, Reader input, int minGram, int maxGram)
factory
- AttributeFactory
to useinput
- Reader
holding the input to be tokenizedminGram
- the smallest n-gram to generatemaxGram
- the largest n-gram to generatepublic boolean incrementToken() throws IOException
incrementToken
in class TokenStream
IOException
public void end() throws IOException
end
in class TokenStream
IOException
public void reset() throws IOException
reset
in class Tokenizer
IOException
Copyright © 2000-2014 Apache Software Foundation. All Rights Reserved.