Uses of Class
org.apache.lucene.analysis.Tokenizer

Packages that use Tokenizer

Package	Description
org.apache.lucene.analysis	API and code to convert text into indexable/searchable tokens.

Uses of Tokenizer in org.apache.lucene.analysis

Fields in org.apache.lucene.analysis declared as Tokenizer

Modifier and Type	Field and Description
protected Tokenizer	Analyzer.TokenStreamComponents.source Original source of the tokens.

Methods in org.apache.lucene.analysis that return Tokenizer

Modifier and Type	Method and Description
Tokenizer	Analyzer.TokenStreamComponents.getTokenizer() Returns the component's Tokenizer

Constructors in org.apache.lucene.analysis with parameters of type Tokenizer

Constructor and Description
Analyzer.TokenStreamComponents(Tokenizer source) Creates a new Analyzer.TokenStreamComponents instance.
Analyzer.TokenStreamComponents(Tokenizer source, TokenStream result) Creates a new Analyzer.TokenStreamComponents instance.