苏州市职业大学学报
囌州市職業大學學報
소주시직업대학학보
JOURNAL OF SUZHOU VOCATIONAL UNIVERSITY
2013年
4期
2-6
,共5页
甲骨卜辞%分词技术%机械分词%特征扫描%Lucene
甲骨蔔辭%分詞技術%機械分詞%特徵掃描%Lucene
갑골복사%분사기술%궤계분사%특정소묘%Lucene
Shang Oracle-bone Inscriptions%segmentation technology%mechanical word segmentation%characteristics scanning%Lucene
依据甲骨文语法及甲骨文词典对甲骨卜辞进行切分,是建立甲骨文语料库实现计算机辅助甲骨文考释的前提和基础。针对甲骨卜辞的切分,采用机械分词与特征扫描相结合的中文分词技术对200条比较完整的卜辞进行切分实验,将只使用机械分词和结合了特征扫描的两种方法进行比较。结果表明,采用机械分词与特征扫描相结合,实现甲骨卜辞的切分的正确率和效率都较高。
依據甲骨文語法及甲骨文詞典對甲骨蔔辭進行切分,是建立甲骨文語料庫實現計算機輔助甲骨文攷釋的前提和基礎。針對甲骨蔔辭的切分,採用機械分詞與特徵掃描相結閤的中文分詞技術對200條比較完整的蔔辭進行切分實驗,將隻使用機械分詞和結閤瞭特徵掃描的兩種方法進行比較。結果錶明,採用機械分詞與特徵掃描相結閤,實現甲骨蔔辭的切分的正確率和效率都較高。
의거갑골문어법급갑골문사전대갑골복사진행절분,시건립갑골문어료고실현계산궤보조갑골문고석적전제화기출。침대갑골복사적절분,채용궤계분사여특정소묘상결합적중문분사기술대200조비교완정적복사진행절분실험,장지사용궤계분사화결합료특정소묘적량충방법진행비교。결과표명,채용궤계분사여특정소묘상결합,실현갑골복사적절분적정학솔화효솔도교고。
To segment the Shang Oracle-bone Inscriptions correctly based on the grammar and the dictionary of the Shang Oracle-bone Inscriptions is the prerequistite for and basis of the establishment of the corpus of the Shang Oracle-bone Inscriptions to realize computer-aided textual explanation.This paper adopts the technology of modern Chinese word segmentation,a combination of mechanical word segmation and Characteristics scanning. In the experiment,200 pieces of Shang Oracle-bone Inscriptions are the experimental samples.We compare the results of the method combined with and without characteristics scanning.The experimental results show that the accuracy and efficiency of segmentation proposed in this paper are both high.