org.apache.lucene.analysis.util
Class TokenizerFactory

java.lang.Object
  extended by org.apache.lucene.analysis.util.AbstractAnalysisFactory
      extended by org.apache.lucene.analysis.util.TokenizerFactory
Direct Known Subclasses:
ArabicLetterTokenizerFactory, ChineseTokenizerFactory, CJKTokenizerFactory, ClassicTokenizerFactory, EdgeNGramTokenizerFactory, KeywordTokenizerFactory, LetterTokenizerFactory, LowerCaseTokenizerFactory, NGramTokenizerFactory, PathHierarchyTokenizerFactory, PatternTokenizerFactory, RussianLetterTokenizerFactory, StandardTokenizerFactory, UAX29URLEmailTokenizerFactory, WhitespaceTokenizerFactory, WikipediaTokenizerFactory

public abstract class TokenizerFactory
extends AbstractAnalysisFactory

Abstract parent class for analysis factories that create Tokenizer instances.


Field Summary
 
Fields inherited from class org.apache.lucene.analysis.util.AbstractAnalysisFactory
args, luceneMatchVersion
 
Constructor Summary
TokenizerFactory()
           
 
Method Summary
static Set<String> availableTokenizers()
          returns a list of all available tokenizer names from context classpath
abstract  Tokenizer create(Reader input)
          Creates a TokenStream of the specified input
static TokenizerFactory forName(String name)
          looks up a tokenizer by name from context classpath
static Class<? extends TokenizerFactory> lookupClass(String name)
          looks up a tokenizer class by name from context classpath
static void reloadTokenizers(ClassLoader classloader)
          Reloads the factory list from the given ClassLoader.
 
Methods inherited from class org.apache.lucene.analysis.util.AbstractAnalysisFactory
assureMatchVersion, getArgs, getBoolean, getBoolean, getInt, getInt, getInt, getLines, getLuceneMatchVersion, getOriginalArgs, getPattern, getSnowballWordSet, getWordSet, init, setLuceneMatchVersion, splitFileNames
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

TokenizerFactory

public TokenizerFactory()
Method Detail

forName

public static TokenizerFactory forName(String name)
looks up a tokenizer by name from context classpath


lookupClass

public static Class<? extends TokenizerFactory> lookupClass(String name)
looks up a tokenizer class by name from context classpath


availableTokenizers

public static Set<String> availableTokenizers()
returns a list of all available tokenizer names from context classpath


reloadTokenizers

public static void reloadTokenizers(ClassLoader classloader)
Reloads the factory list from the given ClassLoader. Changes to the factories are visible after the method ends, all iterators (availableTokenizers(),...) stay consistent.

NOTE: Only new factories are added, existing ones are never removed or replaced.

This method is expensive and should only be called for discovery of new factories on the given classpath/classloader!


create

public abstract Tokenizer create(Reader input)
Creates a TokenStream of the specified input



Copyright © 2000-2013 Apache Software Foundation. All Rights Reserved.