Class SegToken


  • public class SegToken
    extends Object
    SmartChineseAnalyzer internal token
    WARNING: This API is experimental and might change in incompatible ways in the next release.
    • Field Detail

      • charArray

        public char[] charArray
        Character array containing token text
      • startOffset

        public int startOffset
        start offset into original sentence
      • endOffset

        public int endOffset
        end offset into original sentence
      • wordType

        public int wordType
        WordType of the text
      • weight

        public int weight
        word frequency
      • index

        public int index
        during segmentation, this is used to store the index of the token in the token list table
    • Constructor Detail

      • SegToken

        public SegToken​(char[] idArray,
                        int start,
                        int end,
                        int wordType,
                        int weight)
        Create a new SegToken from a character array.
        Parameters:
        idArray - character array containing text
        start - start offset of SegToken in original sentence
        end - end offset of SegToken in original sentence
        wordType - WordType of the text
        weight - word frequency