Uses of Class
org.apache.lucene.analysis.Analyzer.TokenStreamComponents

Package
Description
Text analysis.
Fast, general-purpose grammar-based tokenizer StandardTokenizer implements the Word Break rules from the Unicode Text Segmentation algorithm, as specified in Unicode Standard Annex #29.