public final class WordTokenFilter
extends org.apache.lucene.analysis.TokenFilter
TokenFilter
that breaks sentences into words.Constructor and Description |
---|
WordTokenFilter(org.apache.lucene.analysis.TokenStream in)
Construct a new WordTokenizer.
|
Modifier and Type | Method and Description |
---|---|
boolean |
incrementToken() |
void |
reset() |
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toString
public WordTokenFilter(org.apache.lucene.analysis.TokenStream in)
in
- TokenStream
of sentencespublic boolean incrementToken() throws IOException
incrementToken
in class org.apache.lucene.analysis.TokenStream
IOException
public void reset() throws IOException
reset
in class org.apache.lucene.analysis.TokenFilter
IOException