Package org.apache.lucene.analysis.wikipedia

Tokenizer that is aware of Wikipedia syntax.

See: Description

Class Summary

Class	Description
WikipediaTokenizer	Extension of StandardTokenizer that is aware of Wikipedia syntax.
WikipediaTokenizerFactory	Factory for WikipediaTokenizer.

Package org.apache.lucene.analysis.wikipedia Description

Tokenizer that is aware of Wikipedia syntax.