CAJ | 학술논문

随着社交网络普及，社交网络的数据获取成为首先要解决的问题。针对如何获取社交网站的数据，提出了基于API和网络爬虫的两种方法。通过采取对比试验，分别用两种方式在单位时间内抓取微博，比较抓取的微博条数。实验结果表明，基于API抓取的速度比较快，但是稳定性和数据完整性欠佳；基于网路爬虫方式抓取的速度比较慢，但是稳定性和数据完整性较好。最后提出通过采用两种方式相结合的方式，能够进一步提高抓取效率。
수착사교망락보급，사교망락적수거획취성위수선요해결적문제。침대여하획취사교망참적수거，제출료기우API화망락파충적량충방법。통과채취대비시험，분별용량충방식재단위시간내조취미박，비교조취적미박조수。실험결과표명，기우API조취적속도비교쾌，단시은정성화수거완정성흠가；기우망로파충방식조취적속도비교만，단시은정성화수거완정성교호。최후제출통과채용량충방식상결합적방식，능구진일보제고조취효솔。
With the popularity of social networks,data acquisition of social networks becomes an urgent problem. Two methods based on API and web crawler are proposed for the data acquisition of social network sites. In a contrast test,the two methods were arranged to grab the microblog in a specific time. The results show that the acquisition based on API is quick but data incompleteness and grabbing instability are not good enough,the acquisition based on web crawler is slow but data incom?pleteness and grabbing instability are better. A scheme combining two methods is put forward to further improve the efficiency of data acquisition.