农机化研究
農機化研究
농궤화연구
JOURNAL OF AGRICULTURAL MECHANIZATION RESEARCH
2014年
3期
182-185
,共4页
郭俊军%孟繁疆%张喜海%魏紫京
郭俊軍%孟繁疆%張喜海%魏紫京
곽준군%맹번강%장희해%위자경
网页抓取%大豆主题%主题相关度%农业%搜索引擎
網頁抓取%大豆主題%主題相關度%農業%搜索引擎
망혈조취%대두주제%주제상관도%농업%수색인경
information gathering%soybean subject%subject relevance%agriculture%search engine
农业专业搜索引擎对特定主题的农业信息进行检索,其信息量多、精确度低。针对此现状,以开源搜索引擎Nutch 为技术框架,对大豆主题网页资源采集系统进行了研究与设计。以大豆信息为主题,研究了主题相关度判别技术,借鉴 BM 25 F模型的分域思想、基于向量空间模型,提出了大豆主题相关度判别算法。在 Nutch 中引入IKAnalyzer 中文分词工具包,实现了大豆主题相关度的判别。实验结果表明,该算法能够显著地提高大豆主题网页资源采集的准确率。
農業專業搜索引擎對特定主題的農業信息進行檢索,其信息量多、精確度低。針對此現狀,以開源搜索引擎Nutch 為技術框架,對大豆主題網頁資源採集繫統進行瞭研究與設計。以大豆信息為主題,研究瞭主題相關度判彆技術,藉鑒 BM 25 F模型的分域思想、基于嚮量空間模型,提齣瞭大豆主題相關度判彆算法。在 Nutch 中引入IKAnalyzer 中文分詞工具包,實現瞭大豆主題相關度的判彆。實驗結果錶明,該算法能夠顯著地提高大豆主題網頁資源採集的準確率。
농업전업수색인경대특정주제적농업신식진행검색,기신식량다、정학도저。침대차현상,이개원수색인경Nutch 위기술광가,대대두주제망혈자원채집계통진행료연구여설계。이대두신식위주제,연구료주제상관도판별기술,차감 BM 25 F모형적분역사상、기우향량공간모형,제출료대두주제상관도판별산법。재 Nutch 중인입IKAnalyzer 중문분사공구포,실현료대두주제상관도적판별。실험결과표명,해산법능구현저지제고대두주제망혈자원채집적준학솔。
Presently the amount of information is large and the accuracy is low when agricultural professional search en -gine is retrieving the specific subject agricultural information .In view of the situation , this article makes research and de-sign on the soybean subject webpage resources acquisition system based on the technological framework of Nutch , which is open-source search engine .Taking soybean information as the subject , it researches the technology of subject correla-tion judgment , references to the thought of BM 25 F model and puts forward the algorithm discriminating soybean subject correlation based on vector space model .It introduces the Chinese word segmentation ’ s toolkit of IKAnalyzer Based on the Nutch , and finally realizes the judgment of soybean subject correlation .The experimental results show that the algo-rithm can significantly improve the accuracy of acquainting soybean subject webpage resources .