public class PathHierarchyTokenizer extends Tokenizer
Take something like:
/something/something/elseand make:
/something /something/something /something/something/else
AttributeSource.State
Modifier and Type | Field and Description |
---|---|
static char |
DEFAULT_DELIMITER |
static int |
DEFAULT_SKIP |
DEFAULT_TOKEN_ATTRIBUTE_FACTORY
DEFAULT_ATTRIBUTE_FACTORY
Constructor and Description |
---|
PathHierarchyTokenizer(AttributeFactory factory,
Reader input,
char delimiter,
char replacement,
int skip) |
PathHierarchyTokenizer(AttributeFactory factory,
Reader input,
int bufferSize,
char delimiter,
char replacement,
int skip) |
PathHierarchyTokenizer(Reader input) |
PathHierarchyTokenizer(Reader input,
char delimiter,
char replacement) |
PathHierarchyTokenizer(Reader input,
char delimiter,
char replacement,
int skip) |
PathHierarchyTokenizer(Reader input,
int skip) |
PathHierarchyTokenizer(Reader input,
int bufferSize,
char delimiter) |
PathHierarchyTokenizer(Reader input,
int bufferSize,
char delimiter,
char replacement,
int skip) |
Modifier and Type | Method and Description |
---|---|
void |
end() |
boolean |
incrementToken() |
void |
reset() |
close, correctOffset, setReader
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toString
public static final char DEFAULT_DELIMITER
public static final int DEFAULT_SKIP
public PathHierarchyTokenizer(Reader input)
public PathHierarchyTokenizer(Reader input, int skip)
public PathHierarchyTokenizer(Reader input, int bufferSize, char delimiter)
public PathHierarchyTokenizer(Reader input, char delimiter, char replacement)
public PathHierarchyTokenizer(Reader input, char delimiter, char replacement, int skip)
public PathHierarchyTokenizer(AttributeFactory factory, Reader input, char delimiter, char replacement, int skip)
public PathHierarchyTokenizer(Reader input, int bufferSize, char delimiter, char replacement, int skip)
public PathHierarchyTokenizer(AttributeFactory factory, Reader input, int bufferSize, char delimiter, char replacement, int skip)
public final boolean incrementToken() throws IOException
incrementToken
in class TokenStream
IOException
public final void end() throws IOException
end
in class TokenStream
IOException
public void reset() throws IOException
reset
in class Tokenizer
IOException
Copyright © 2000-2014 Apache Software Foundation. All Rights Reserved.