Class DictionaryToken


  • public class DictionaryToken
    extends Token
    A token stored in a Dictionary.
    • Constructor Detail

      • DictionaryToken

        public DictionaryToken​(KoreanTokenizer.Type type,
                               Dictionary dictionary,
                               int wordId,
                               char[] surfaceForm,
                               int offset,
                               int length,
                               int startOffset,
                               int endOffset)
    • Method Detail

      • getType

        public KoreanTokenizer.Type getType()
        Returns the type of this token
        Returns:
        token type, not null
      • isKnown

        public boolean isKnown()
        Returns true if this token is known word
        Returns:
        true if this token is in standard dictionary. false if not.
      • isUnknown

        public boolean isUnknown()
        Returns true if this token is unknown word
        Returns:
        true if this token is unknown word. false if not.
      • isUser

        public boolean isUser()
        Returns true if this token is defined in user dictionary
        Returns:
        true if this token is in user dictionary. false if not.
      • getLeftPOS

        public POS.Tag getLeftPOS()
        Description copied from class: Token
        Get the left part of speech of the token.
        Specified by:
        getLeftPOS in class Token
      • getRightPOS

        public POS.Tag getRightPOS()
        Description copied from class: Token
        Get the right part of speech of the token.
        Specified by:
        getRightPOS in class Token
      • getReading

        public String getReading()
        Description copied from class: Token
        Get the reading of the token.
        Specified by:
        getReading in class Token