Package org.apache.lucene.analysis.miscellaneous

Class RemoveDuplicatesTokenFilterFactory

java.lang.Object

org.apache.lucene.analysis.AbstractAnalysisFactory

org.apache.lucene.analysis.TokenFilterFactory

org.apache.lucene.analysis.miscellaneous.RemoveDuplicatesTokenFilterFactory

public class RemoveDuplicatesTokenFilterFactory
extends TokenFilterFactory

Factory for RemoveDuplicatesTokenFilter.

 <fieldType name="text_rmdup" class="solr.TextField" positionIncrementGap="100">
   <analyzer>
     <tokenizer class="solr.WhitespaceTokenizerFactory"/>
     <filter class="solr.RemoveDuplicatesTokenFilterFactory"/>
   </analyzer>
 </fieldType>

Since:

3.1

SPI Name (case-insensitive: if the name is 'htmlStrip', 'htmlstrip' can be used when looking up the service).

"removeDuplicates"

Field Summary

Fields

Modifier and Type	Field	Description
static final String	NAME	SPI name

Fields inherited from class org.apache.lucene.analysis.AbstractAnalysisFactory

LUCENE_MATCH_VERSION_PARAM, luceneMatchVersion

Constructor Summary

Constructors

Constructor	Description
RemoveDuplicatesTokenFilterFactory()	Default ctor for compatibility with SPI
RemoveDuplicatesTokenFilterFactory(Map<String,String> args)	Creates a new RemoveDuplicatesTokenFilterFactory

Method Summary

Modifier and Type	Method	Description
RemoveDuplicatesTokenFilter	create(TokenStream input)

Methods inherited from class org.apache.lucene.analysis.TokenFilterFactory

availableTokenFilters, findSPIName, forName, lookupClass, normalize, reloadTokenFilters

Methods inherited from class org.apache.lucene.analysis.AbstractAnalysisFactory

defaultCtorException, get, get, get, get, get, getBoolean, getChar, getClassArg, getFloat, getInt, getLines, getLuceneMatchVersion, getOriginalArgs, getPattern, getSet, getSnowballWordSet, getWordSet, isExplicitLuceneMatchVersion, require, require, require, requireBoolean, requireChar, requireFloat, requireInt, setExplicitLuceneMatchVersion, splitAt, splitFileNames

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

NAME

public static final String NAME

SPI name

See Also:

• Constant Field Values

Constructor Details

RemoveDuplicatesTokenFilterFactory

public RemoveDuplicatesTokenFilterFactory(Map<String,String> args)

Creates a new RemoveDuplicatesTokenFilterFactory

RemoveDuplicatesTokenFilterFactory

public RemoveDuplicatesTokenFilterFactory()

Default ctor for compatibility with SPI

Method Details

create

public RemoveDuplicatesTokenFilter create(TokenStream input)

Specified by:

create in class TokenFilterFactory