CAJ | 학술논문

随着互联网爆炸式的发展，网络爬虫的重要性越来越重要。一个搜索引擎搜索结果的数量以及质量在一定程度上取决于网络爬虫爬取结果的质量，而如何能更好的组织这些爬虫也成了一件能影响爬虫效率的事情。随着在服务器上部署爬虫的增加，对一个能够有效管理爬虫监控系统的需求也就越来越紧迫。本文对爬虫监控系统的设计和实现将会给爬虫的管理带来很大的方便。
수착호련망폭작식적발전，망락파충적중요성월래월중요。일개수색인경수색결과적수량이급질량재일정정도상취결우망락파충파취결과적질량，이여하능경호적조직저사파충야성료일건능영향파충효솔적사정。수착재복무기상부서파충적증가，대일개능구유효관리파충감공계통적수구야취월래월긴박。본문대파충감공계통적설계화실현장회급파충적관리대래흔대적방편。
With the explosive growth of Internet, the importance of web crawler is becoming increasingly important. The quantity and quality of search results of a search engine is depends to some extent on the quality of web crawler's crawling results, and how to organize these crawlers better have become a things can affect the efficiency of crawler. With the increase of crawlers deployed on the server, the need for an effective management of monitoring system is more and more urgent. In this paper, the design and implementation of reptile monitoring system will bring great convenience to the crawler's management.