org.apache.lucene.analysis.ru
Class RussianLetterTokenizer
java.lang.Object
org.apache.lucene.util.AttributeSource
org.apache.lucene.analysis.TokenStream
org.apache.lucene.analysis.Tokenizer
org.apache.lucene.analysis.CharTokenizer
org.apache.lucene.analysis.ru.RussianLetterTokenizer
- All Implemented Interfaces:
- Closeable
public class RussianLetterTokenizer
- extends CharTokenizer
A RussianLetterTokenizer is a Tokenizer
that extends LetterTokenizer
by also allowing the basic latin digits 0-9.
Fields inherited from class org.apache.lucene.analysis.Tokenizer |
input |
Methods inherited from class org.apache.lucene.util.AttributeSource |
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toString |
RussianLetterTokenizer
public RussianLetterTokenizer(Reader in)
RussianLetterTokenizer
public RussianLetterTokenizer(AttributeSource source,
Reader in)
RussianLetterTokenizer
public RussianLetterTokenizer(AttributeSource.AttributeFactory factory,
Reader in)
isTokenChar
protected boolean isTokenChar(char c)
- Collects only characters which satisfy
Character.isLetter(char)
.
- Specified by:
isTokenChar
in class CharTokenizer
Copyright © 2000-2010 Apache Software Foundation. All Rights Reserved.