CAJ | 학술논문

在中文词法分析中,分词是词性标注必须经历的阶段.为了能在分词阶段就充分利用词性标注的信息和减少两阶段错误的累计,最好的方法是将两个阶段,整合到一个架构中.该文以无向图模型为基础,将分词和词性标注有机地统一在一个序列标注模型中.由于可以采用更深层次的依赖关系作为特征,一体化系统在1998年人民日报语料上取得了97.19%的分词精确率和95.34%的词性标注精确率,是目前同类系统,在这一语料上取得的最好结果.
재중문사법분석중,분사시사성표주필수경력적계단.위료능재분사계단취충분이용사성표주적신식화감소량계단착오적루계,최호적방법시장량개계단,정합도일개가구중.해문이무향도모형위기출,장분사화사성표주유궤지통일재일개서렬표주모형중.유우가이채용경심층차적의뢰관계작위특정,일체화계통재1998년인민일보어료상취득료97.19%적분사정학솔화95.34%적사성표주정학솔,시목전동류계통,재저일어료상취득적최호결과.
For Chinese Part-Of-Speech(POS) tagging, word segmentation is a preliminary step. To reduce accumulated errors between two steps and improve the segmentation performance by utilizing POS information, segmentation and POS tagging can be performed simultaneously. In this paper, a joint segmentation and POS tagging system is proposed based on undirected graphical models which can make full use of the dependencies between the two stages. In the joint system, segmenting and tagging are viewed as the sequence labeling; moreover any connected sub-graph can be viewed as a certain dependency which can be used to find the final opinion labeling. The joint model achieves high performances with 97.19% in segmentation precision and 95.34% in POS tagging precision, which are the state-of-art performances for Chinese word segmentation and tagging on 1998-year People's Daily corpus.