java.lang.Object
org.apache.lucene.analysis.cn.smart.hhmm.SegToken

public class SegToken extends Object
SmartChineseAnalyzer internal token
WARNING: This API is experimental and might change in incompatible ways in the next release.
  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    char[]
    Character array containing token text
    int
    end offset into original sentence
    int
    during segmentation, this is used to store the index of the token in the token list table
    int
    start offset into original sentence
    int
    word frequency
    int
    WordType of the text
  • Constructor Summary

    Constructors
    Constructor
    Description
    SegToken(char[] idArray, int start, int end, int wordType, int weight)
    Create a new SegToken from a character array.
  • Method Summary

    Modifier and Type
    Method
    Description
    boolean
     
    int
     

    Methods inherited from class java.lang.Object

    clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait
  • Field Details

    • charArray

      public char[] charArray
      Character array containing token text
    • startOffset

      public int startOffset
      start offset into original sentence
    • endOffset

      public int endOffset
      end offset into original sentence
    • wordType

      public int wordType
      WordType of the text
    • weight

      public int weight
      word frequency
    • index

      public int index
      during segmentation, this is used to store the index of the token in the token list table
  • Constructor Details

    • SegToken

      public SegToken(char[] idArray, int start, int end, int wordType, int weight)
      Create a new SegToken from a character array.
      Parameters:
      idArray - character array containing text
      start - start offset of SegToken in original sentence
      end - end offset of SegToken in original sentence
      wordType - WordType of the text
      weight - word frequency
  • Method Details