public class EnhancementsCategoryTokenizer extends CategoryTokenizer
CategoryEnhancements defined in the given
EnhancementsIndexingParams.AttributeSource.AttributeFactory, AttributeSource.State| Modifier and Type | Field and Description |
|---|---|
protected byte[][] |
enhancementBytes
Buffers for enhancement payload bytes
|
protected List<CategoryEnhancement> |
enhancements
The category enhancements to handle
|
protected byte[] |
payloadBytes
The data buffer used for payload instance.
|
categoryAttribute, indexingParams, payload, payloadAttribute, termAttributeinput| Constructor and Description |
|---|
EnhancementsCategoryTokenizer(TokenStream input,
EnhancementsIndexingParams indexingParams)
Constructor.
|
| Modifier and Type | Method and Description |
|---|---|
protected void |
setPayload()
Set the payload of the current category token.
|
incrementTokenclose, end, resetaddAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toStringprotected byte[] payloadBytes
protected List<CategoryEnhancement> enhancements
protected byte[][] enhancementBytes
public EnhancementsCategoryTokenizer(TokenStream input, EnhancementsIndexingParams indexingParams) throws IOException
input - The stream of category tokens.indexingParams - The indexing params to use.IOExceptionprotected void setPayload()
CategoryTokenizersetPayload in class CategoryTokenizer