CAJ | 학술논문

在跨语言文本分析任务中，多词短语比单个词汇歧义小，语义表达更加准确，有助于提高文本理解的准确性。现有方法主要关注单个词的跨语言对齐。将多词短语抽取和跨语言对齐相融合，提出了一种基于多策略过滤的汉日多词短语抽取和对齐的方法。首先从一个语种出发，通过重复串、左右邻接熵、内部关联度、多词嵌套、停用词等方法提取并过滤得到具备完整语义的多词短语，然后利用平行语料库计算汉日多词短语的相似度，实现跨语言对齐。在整个过程中可结合日语语言规则与特点，根据语料规模、相关领域对过滤阈值进行动态调整，提高了多词短语的领域适用性。实验结果表明，该方法可有效抽取汉日多词短语并进行准确对齐，以多词短语为对齐单元，语义表达更完整，实用价值更大。
재과어언문본분석임무중，다사단어비단개사회기의소，어의표체경가준학，유조우제고문본리해적준학성。현유방법주요관주단개사적과어언대제。장다사단어추취화과어언대제상융합，제출료일충기우다책략과려적한일다사단어추취화대제적방법。수선종일개어충출발，통과중복천、좌우린접적、내부관련도、다사감투、정용사등방법제취병과려득도구비완정어의적다사단어，연후이용평행어료고계산한일다사단어적상사도，실현과어언대제。재정개과정중가결합일어어언규칙여특점，근거어료규모、상관영역대과려역치진행동태조정，제고료다사단어적영역괄용성。실험결과표명，해방법가유효추취한일다사단어병진행준학대제，이다사단어위대제단원，어의표체경완정，실용개치경대。
On the task of cross-language text analysis,a multi-word phrase is less ambiguous and more accurate than a single word,which helps to understand the text more accurately.Existing methods mainly focus on cross-language alignment of single words.This paper presents an extraction and alignment method for Chinese-Japanese multi-word phrases based on multi-strategy filtering,which combines the multi-word phrases extraction and cross-language align-ment.Firstly,we get multi-word phrases with complete semantics using repeated string,left-right adjacent entropy,in-ternal relationship,multi-word nesting,stop-word method etc.Secondly,we use the parallel corpus to compute the similarity of Chinese-Japanese multi-word phrases,to achieve cross-language alignment.In the process,according to the rules and characteristics of the Japanese language,we dynamically adjust the threshold according to corpus’size and related domains,in order to improve the applicability of multi-word phrases.The experimental results show that this method is effective to extract Chinese-Japanese multi-word phrases as the alignment unit,which makes the semantic ex-pression more complete and more practical value.