org.apache.lucene.analysis.core

Class LetterTokenizerFactory

java.lang.Object

org.apache.lucene.analysis.util.AbstractAnalysisFactory

org.apache.lucene.analysis.util.TokenizerFactory

org.apache.lucene.analysis.core.LetterTokenizerFactory

public class LetterTokenizerFactory
extends TokenizerFactory

Factory for LetterTokenizer.

 <fieldType name="text_letter" class="solr.TextField" positionIncrementGap="100">
   <analyzer>
     <tokenizer class="solr.LetterTokenizerFactory" maxTokenLen="256"/>
   </analyzer>
 </fieldType>

Options:

• maxTokenLen: max token length, must be greater than 0 and less than MAX_TOKEN_LENGTH_LIMIT (1024*1024). It is rare to need to change this else CharTokenizer::DEFAULT_MAX_TOKEN_LEN

Since:

3.1

Field Summary

Fields inherited from class org.apache.lucene.analysis.util.AbstractAnalysisFactory

LUCENE_MATCH_VERSION_PARAM, luceneMatchVersion

Constructor Summary

Constructors

Constructor and Description
LetterTokenizerFactory(Map<String,String> args) Creates a new LetterTokenizerFactory

Method Summary

Modifier and Type	Method and Description
LetterTokenizer	create(AttributeFactory factory) Creates a TokenStream of the specified input using the given AttributeFactory

Methods inherited from class org.apache.lucene.analysis.util.TokenizerFactory

availableTokenizers, create, forName, lookupClass, reloadTokenizers

Methods inherited from class org.apache.lucene.analysis.util.AbstractAnalysisFactory

get, get, get, get, get, getBoolean, getChar, getClassArg, getFloat, getInt, getLines, getLuceneMatchVersion, getOriginalArgs, getPattern, getSet, getSnowballWordSet, getWordSet, isExplicitLuceneMatchVersion, require, require, require, requireBoolean, requireChar, requireFloat, requireInt, setExplicitLuceneMatchVersion, splitAt, splitFileNames

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LetterTokenizerFactory

public LetterTokenizerFactory(Map<String,String> args)

Creates a new LetterTokenizerFactory

Method Detail

create

public LetterTokenizer create(AttributeFactory factory)

Description copied from class: TokenizerFactory

Creates a TokenStream of the specified input using the given AttributeFactory

Specified by:

create in class TokenizerFactory