Class SegTokenFilter
- java.lang.Object
-
- org.apache.lucene.analysis.cn.smart.hhmm.SegTokenFilter
-
public class SegTokenFilter extends Object
Filters aSegToken
by converting full-width latin to half-width, then lowercasing latin. Additionally, all punctuation is converted intoUtility.COMMON_DELIMITER
- WARNING: This API is experimental and might change in incompatible ways in the next release.
-
-
Constructor Summary
Constructors Constructor Description SegTokenFilter()
-