public final class WordTokenFilter extends TokenFilter
TokenFilter
that breaks sentences into words.AttributeSource.AttributeFactory, AttributeSource.State
input
Constructor and Description |
---|
WordTokenFilter(TokenStream in)
Construct a new WordTokenizer.
|
Modifier and Type | Method and Description |
---|---|
boolean |
incrementToken() |
void |
reset() |
close, end
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState
public WordTokenFilter(TokenStream in)
in
- TokenStream
of sentencespublic boolean incrementToken() throws IOException
incrementToken
in class TokenStream
IOException
public void reset() throws IOException
reset
in class TokenFilter
IOException
Copyright © 2000-2013 Apache Software Foundation. All Rights Reserved.