Class Token

java.lang.Object
org.apache.lucene.analysis.morph.Token
org.apache.lucene.analysis.ko.Token
Direct Known Subclasses:
DecompoundToken, DictionaryToken

public abstract class Token extends Token
Analyzed token with morphological data.
  • Constructor Details

    • Token

      protected Token(char[] surfaceForm, int offset, int length, int startOffset, int endOffset, TokenType type)
  • Method Details

    • getPOSType

      public abstract POS.Type getPOSType()
      Get the POS.Type of the token.
    • getLeftPOS

      public abstract POS.Tag getLeftPOS()
      Get the left part of speech of the token.
    • getRightPOS

      public abstract POS.Tag getRightPOS()
      Get the right part of speech of the token.
    • getReading

      public abstract String getReading()
      Get the reading of the token.
    • getMorphemes

      public abstract KoMorphData.Morpheme[] getMorphemes()
      Get the KoMorphData.Morpheme decomposition of the token.