Class WikipediaTokenizer

  • All Implemented Interfaces:
    Closeable, AutoCloseable

    public final class WikipediaTokenizer
    extends Tokenizer
    Extension of StandardTokenizer that is aware of Wikipedia syntax. It is based off of the Wikipedia tutorial available at, but it may not be complete.
    WARNING: This API is experimental and might change in incompatible ways in the next release.