Uses of Class
org.apache.lucene.analysis.util.CharTokenizer
Package
Description
Basic, general-purpose analysis components.
Utility functions for text analysis.
-
Uses of CharTokenizer in org.apache.lucene.analysis.core
Modifier and TypeClassDescriptionclass
A LetterTokenizer is a tokenizer that divides text at non-letters.final class
A UnicodeWhitespaceTokenizer is a tokenizer that divides text at whitespace.final class
A tokenizer that divides text at whitespace characters as defined byCharacter.isWhitespace(int)
. -
Uses of CharTokenizer in org.apache.lucene.analysis.util
Modifier and TypeMethodDescriptionstatic CharTokenizer
CharTokenizer.fromSeparatorCharPredicate
(IntPredicate separatorCharPredicate) Creates a new instance of CharTokenizer using a custom predicate, supplied as method reference or lambda expression.static CharTokenizer
CharTokenizer.fromSeparatorCharPredicate
(AttributeFactory factory, IntPredicate separatorCharPredicate) Creates a new instance of CharTokenizer with the supplied attribute factory using a custom predicate, supplied as method reference or lambda expression.static CharTokenizer
CharTokenizer.fromTokenCharPredicate
(IntPredicate tokenCharPredicate) Creates a new instance of CharTokenizer using a custom predicate, supplied as method reference or lambda expression.static CharTokenizer
CharTokenizer.fromTokenCharPredicate
(AttributeFactory factory, IntPredicate tokenCharPredicate) Creates a new instance of CharTokenizer with the supplied attribute factory using a custom predicate, supplied as method reference or lambda expression.