关键词: 语块分析, 流形距离, 层次聚类, 语法功能空间

Abstract: Regarding the Chinese chunker analysis as a procedure of inner-sentence word clustering and chunker type labeling, a grammar function space is constructed at first, and then embedded in a lower dimension space by applying ISOMAP to observe the distribution feature of Chinese word in the embedding space. In the hierarchical clustering algorithm which is aiming at partitioning word into different clusters, the manifold geodesic distance is employed instead of Euclidean distance to measure the similarity between words. The algorithm facilitates the increment of Chinese chunker analysis performance under the condition of appropriate algorithm complexity.

Key words: chunker analysis, manifold geodesic distance, hierarchical clustring, grammar function space