Uses of Package
org.apache.lucene.analysis.tokenattributes

Package
Description
Fast, general-purpose grammar-based tokenizer StandardTokenizer implements the Word Break rules from the Unicode Text Segmentation algorithm, as specified in Unicode Standard Annex #29.
General-purpose attributes for text analysis.