Package org.apache.lucene.analysis.cn.smart

Analyzer for Simplified Chinese, which indexes words.

See: Description

Class Summary

Class	Description
AnalyzerProfile	Manages analysis data configuration for SmartChineseAnalyzer
CharType	Internal SmartChineseAnalyzer character type constants.
HMMChineseTokenizer	Tokenizer for Chinese or mixed Chinese-English text.
HMMChineseTokenizerFactory	Factory for HMMChineseTokenizer
SentenceTokenizer	Deprecated Use HMMChineseTokenizer instead
SmartChineseAnalyzer	SmartChineseAnalyzer is an analyzer for Chinese or mixed Chinese-English text.
SmartChineseSentenceTokenizerFactory	Deprecated Use HMMChineseTokenizerFactory instead
SmartChineseWordTokenFilterFactory	Deprecated Use HMMChineseTokenizerFactory instead
Utility	SmartChineseAnalyzer utility constants and methods
WordTokenFilter	Deprecated Use HMMChineseTokenizer instead.
WordType	Internal SmartChineseAnalyzer token type constants

Package org.apache.lucene.analysis.cn.smart Description

Analyzer for Simplified Chinese, which indexes words.

WARNING: This API is experimental and might change in incompatible ways in the next release.

Three analyzers are provided for Chinese, each of which treats Chinese text in a different way.

• StandardAnalyzer: Index unigrams (individual Chinese characters) as a token.
• CJKAnalyzer (in the analyzers/cjk package): Index bigrams (overlapping groups of two adjacent Chinese characters) as tokens.
• SmartChineseAnalyzer (in this package): Index words (attempt to segment Chinese text into words) as tokens.

Example phrase： "我是中国人"

1. StandardAnalyzer: 我－是－中－国－人
2. CJKAnalyzer: 我是－是中－中国－国人
3. SmartChineseAnalyzer: 我－是－中国－人